00000001:02000400:3.0F:1787852783.301881:0:2960:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg401-server.virtnet: executing set_hostid 00000001:02000400:2.0F:1787852810.234953:0:3182:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg401-server.virtnet: executing load_modules_local 00000001:01000000:0.0F:1787852812.453060:0:3242:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 592 MB/s 00000001:01000000:1.0F:1787852812.704679:0:3242:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 507 MB/s 00000001:01000000:2.0:1787852812.960485:0:3242:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 3593 MB/s 00000020:02000000:3.0:1787852813.841001:0:3274:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_84_g466c428 00000400:02000000:2.0:1787852814.989681:0:3290:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.204.101@tcp [8/256/0/180] 00008000:02000000:0.0:1787852819.048183:0:3439:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:3.0:1787852883.994973:0:5248:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg401-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1787852898.005948:0:5818:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787852898.005955:0:5818:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1787852898.006136:0:5818:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000e01c149f 00000080:02000400:2.0:1787852898.006147:0:5818:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1787852898.013243:0:5818:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1787852898.013328:0:5818:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1787852898.013375:0:5818:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (0000000048b6aaac) 00000020:00000080:2.0:1787852898.013397:0:5818:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787852898.033557:0:5818:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1787852898.034441:0:5818:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1787852898.067527:0:5818:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:0.0:1787852898.067746:0:5818:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1787852898.067779:0:5818:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:0.0:1787852898.067834:0:5818:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1787852898.068798:0:5818:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:0.0:1787852898.069391:0:5818:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1787852898.069400:0:5818:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787852898.069412:0:5818:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x710df789068e5e73 00000020:01000004:0.0:1787852898.069418:0:5818:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:0.0:1787852898.069423:0:5818:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1787852898.069427:0:5818:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000e01c149f from MGS 00000020:01000004:0.0:1787852898.069431:0:5818:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1787852898.069446:0:5818:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000005f55d115) 00000020:00000080:0.0:1787852898.069458:0:5818:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1787852898.069716:0:5818:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000e01c149f from MGS, refs=2 00080000:01000000:0.0:1787852898.069722:0:5818:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787852898.069727:0:5818:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x710df789068e5e81 00000100:00100000:0.0:1787852898.069825:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1787852898.070132:0:5818:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1787852898.070137:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1787852898.071110:0:5818:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1787852898.071118:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1787852898.071947:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787852898.072127:0:5818:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1787852898.072132:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1787852898.073287:0:5818:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1787852898.073297:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1787852898.075474:0:5818:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1787852898.075487:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1787852898.077520:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787852898.077525:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787852898.077527:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787852898.078349:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787852898.078352:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787852898.078359:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787852898.079993:0:5818:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1787852898.083445:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1787852898.330050:0:5818:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 1411 MB/s 00000001:01000000:1.0:1787852898.580506:0:5818:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2199 MB/s 00000001:01000000:2.0:1787852898.831173:0:5818:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 507 MB/s 00000001:01000000:0.0:1787852899.080829:0:5818:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 1079 MB/s 00080000:10000000:0.0:1787852899.086486:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:0.0:1787852899.094821:0:5818:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:0.0:1787852899.094838:0:5818:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1787852899.094840:0:5818:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:0.0:1787852899.095605:0:5828:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1787852899.095714:0:5818:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1787852899.095766:0:5818:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:1.0:1787852899.095977:0:5818:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1787852899.096001:0:5818:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1787852899.096344:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787852899.096492:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1787852899.096498:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1787852899.097091:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1787852899.097098:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1787852899.097406:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1787852899.097413:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1787852899.098033:0:5818:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1787852899.098054:0:5818:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.101@tcp' 00000020:01000004:0.0:1787852899.098056:0:5818:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1787852899.098111:0:5818:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.101@tcp (typ=mgc) 00000020:00000080:0.0:1787852899.098123:0:5818:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.101@tcp (0000000014160fbd) 00000020:00000080:0.0:1787852899.098137:0:5818:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1787852899.098231:0:5818:0:(ldlm_lib.c:102:import_set_conn()) imp 000000002addc0a8@MGC192.168.204.101@tcp: add connection 192.168.204.101@tcp at head 00010000:00010000:0.0:1787852899.098390:0:5818:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.101@tcp-0 is initialized 00000040:01000000:0.0:1787852899.098397:0:5818:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.101@tcp ctxt 1 is initialized 00000100:00080000:1.0:1787852899.101692:0:5833:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:1.0:1787852899.101820:0:5834:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1787852899.101902:0:5818:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.101@tcp (uuid 5d48a955-7010-4118-9c7d-f396984ae1ff) 00000020:00000080:0.0:1787852899.101928:0:5818:0:(genops.c:1385:class_connect()) connect: client 5d48a955-7010-4118-9c7d-f396984ae1ff, cookie 0x710df789068e5e8f 00000100:00080000:0.0:1787852899.101944:0:5818:0:(import.c:510:import_select_connection()) MGC192.168.204.101@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787852899.101950:0:5818:0:(import.c:624:import_select_connection()) MGC192.168.204.101@tcp: import 000000002addc0a8 using connection 192.168.204.101@tcp/0@lo 00000100:00100000:0.0:1787852899.101986:0:5818:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000dfb466f9 x1874699552292992/t0(0) o250->MGC192.168.204.101@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787852899.102015:0:5818:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 5d48a955-7010-4118-9c7d-f396984ae1ff->MGS 00000020:01000004:0.0:1787852899.102035:0:5818:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1787852899.102060:0:5818:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1787852899.102073:0:5818:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000007af263d9) 00000020:00000080:0.0:1787852899.102086:0:5818:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1787852899.104876:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dfb466f9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5d48a955-7010-4118-9c7d-f396984ae1ff:3305:1874699552292992:0@lo:250: 00000100:00100000:1.0:1787852899.105018:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787852899.105093:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552292992 00000100:00100000:1.0:1787852899.105103:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552292992 00000100:00100000:1.0:1787852899.105144:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787852899.105152:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f757c9b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3305:x1874699552292992:12345-0@lo:250: 00010000:00080000:1.0:1787852899.105180:0:5829:0:(ldlm_lib.c:1454:target_handle_connect()) MGS: connection from 5d48a955-7010-4118-9c7d-f396984ae1ff@0@lo t0 exp 0000000000000000 cur 218 last 0 00000020:00000080:1.0:1787852899.105211:0:5829:0:(genops.c:1385:class_connect()) connect: client 5d48a955-7010-4118-9c7d-f396984ae1ff, cookie 0x710df789068e5e9d 00000100:00080000:1.0:1787852899.105358:0:5829:0:(import.c:65:import_set_state_nolock()) 00000000fa85f8a3 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787852899.105423:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f757c9b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+5:3305:x1874699552292992:12345-0@lo:250: Request processed in 271us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1787852899.105431:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787852899.105552:0:3305:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.204.101@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1787852899.105563:0:3305:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.204.101@tcp: connect to target with instance 0 00000100:00080000:2.0:1787852899.105587:0:3305:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.204.101@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1787852899.105593:0:3305:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1787852899.105596:0:3305:0:(import.c:65:import_set_state_nolock()) 000000002addc0a8 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1787852899.105599:0:3305:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1787852899.105615:0:3305:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1787852899.105619:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dfb466f9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5d48a955-7010-4118-9c7d-f396984ae1ff:3305:1874699552292992:0@lo:250: 00000100:00100000:0.0:1787852899.112917:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787852899.113135:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1787852899.113143:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1787852899.113906:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1787852899.113925:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1787852899.114368:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1787852899.114375:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1787852899.115314:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787852899.115558:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1787852899.115564:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1787852899.116080:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1787852899.116086:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00010000:00010000:0.0:1787852899.117310:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787852899.139455:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787852899.139714:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1787852899.139721:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1787852899.140898:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1787852899.140911:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1787852899.141549:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787852899.141807:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787852899.141811:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1787852899.142275:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787852899.142282:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1787852899.142953:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787852899.143111:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787852899.143117:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1787852899.143709:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787852899.143716:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1787852899.145071:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787852899.145242:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787852899.145259:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1787852899.145776:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787852899.145784:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1787852899.172559:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787852899.172988:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1787852899.172994:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1787852899.176775:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1787852899.176794:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1787852899.179238:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1787852899.179262:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1787852899.181411:0:5818:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1787852899.181442:0:5818:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1787852899.181449:0:5818:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.101@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1787852899.181929:0:5818:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.101@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787852899.181979:0:5818:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.101@tcp, index=0000, flags=0x20065 00000020:01000004:1.0:1787852899.181984:0:5818:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787852899.181987:0:5818:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787852899.181988:0:5818:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787852899.181989:0:5818:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787852899.181990:0:5818:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787852899.181992:0:5818:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787852899.181994:0:5818:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787852899.181996:0:5818:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787852899.181997:0:5818:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787852899.181998:0:5818:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787852899.182000:0:5818:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787852899.182001:0:5818:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787852899.182004:0:5818:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:1.0:1787852899.182006:0:5818:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787852899.182007:0:5818:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787852899.182008:0:5818:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787852899.182009:0:5818:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787852899.182010:0:5818:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787852899.182011:0:5818:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787852899.182012:0:5818:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787852899.182013:0:5818:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787852899.182014:0:5818:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787852899.182014:0:5818:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787852899.182015:0:5818:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787852899.182016:0:5818:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787852899.182044:0:5818:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1787852899.182064:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b73a24e7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d48a955-7010-4118-9c7d-f396984ae1ff:5818:1874699552293120:0@lo:253: 00000100:00100000:1.0:1787852899.182228:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787852899.182369:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b3a0effb going to sleep for 11 seconds 00000100:00100000:0.0:1787852899.186404:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552293120 00000100:00100000:0.0:1787852899.186420:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552293120 00000100:00100000:0.0:1787852899.186592:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787852899.186603:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e2c3dcb2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d48a955-7010-4118-9c7d-f396984ae1ff+5:5818:x1874699552293120:12345-0@lo:253: 20000000:01000000:0.0:1787852899.186653:0:5831:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787852899.186656:0:5831:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:3.0:1787852899.187265:0:5852:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1787852899.187333:0:5831:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:0.0:1787852899.187763:0:5831:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787852899.188651:0:5853:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:0.0:1787852899.188855:0:5831:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787852899.188858:0:5831:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:0.0:1787852899.188864:0:5831:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:0.0:1787852899.188867:0:5831:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:0.0:1787852899.188879:0:5831:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:0.0:1787852899.189058:0:5831:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787852899.189371:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:0.0:1787852899.189383:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1787852899.189426:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:0.0:1787852899.189468:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:0.0:1787852899.189499:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:0.0:1787852899.189767:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:0.0:1787852899.189777:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:0.0:1787852899.189826:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:0.0:1787852899.189835:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:0.0:1787852899.189867:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:0.0:1787852899.189874:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:0.0:1787852899.189916:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:0.0:1787852899.189960:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:0.0:1787852899.189993:0:5831:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1787852899.189998:0:5831:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:0.0:1787852899.190009:0:5831:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787852899.190378:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:0.0:1787852899.190388:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1787852899.190420:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:0.0:1787852899.190449:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:0.0:1787852899.190490:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:0.0:1787852899.190501:0:5831:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:0.0:1787852899.190683:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:0.0:1787852899.190692:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1787852899.190735:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:0.0:1787852899.190771:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:0.0:1787852899.190800:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:0.0:1787852899.190811:0:5831:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:0.0:1787852899.190882:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:0.0:1787852899.190890:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:0.0:1787852899.190917:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:0.0:1787852899.190950:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:0.0:1787852899.191102:0:5831:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:0.0:1787852899.191224:0:5831:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1787852899.191232:0:5831:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:3.0:1787852899.191711:0:5854:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:0.0:1787852899.191955:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:0.0:1787852899.191975:0:5831:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.204.101@tcp for mdt 20000000:01000000:0.0:1787852899.191977:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.101@tcp (null) (null) (null) 00000040:00080000:0.0:1787852899.192008:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:0.0:1787852899.192016:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1787852899.192045:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:0.0:1787852899.192052:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.204.101@tcp (null) (null) 00000040:00080000:0.0:1787852899.192092:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:0.0:1787852899.192188:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1787852899.192226:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:0.0:1787852899.192275:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:0.0:1787852899.192330:0:5831:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:0.0:1787852899.192333:0:5831:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1787852899.192337:0:5831:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1787852899.192348:0:5831:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1787852899.192350:0:5831:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1787852899.192378:0:5831:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1787852899.192380:0:5831:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1787852899.192874:0:5855:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:0.0:1787852899.193081:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:0.0:1787852899.193199:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:0.0:1787852899.193289:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:0.0:1787852899.193302:0:5831:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1787852899.193304:0:5831:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:3.0:1787852899.193717:0:5856:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:0.0:1787852899.193934:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:0.0:1787852899.193970:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:0.0:1787852899.193999:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:0.0:1787852899.194009:0:5831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787852899.194012:0:5831:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:0.0:1787852899.194015:0:5831:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1787852899.194017:0:5831:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1787852899.194022:0:5831:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1787852899.194028:0:5831:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1787852899.194723:0:5857:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:0.0:1787852899.194807:0:5831:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:0.0:1787852899.201813:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:0.0:1787852899.201886:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:0.0:1787852899.201967:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:0.0:1787852899.201987:0:5831:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1787852899.202007:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000004e2d2f48/0x710df789068e5ea4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852899.202037:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004e2d2f48/0x710df789068e5ea4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852899.202047:0:5831:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000004e2d2f48/0x710df789068e5ea4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852899.202053:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000004e2d2f48/0x710df789068e5ea4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852899.202059:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000004e2d2f48/0x710df789068e5ea4 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852899.202066:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000004e2d2f48/0x710df789068e5ea4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852899.202072:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000004e2d2f48 already unused, calling callback (00000000ee1a6bb8) 00010000:00010000:0.0:1787852899.202075:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000004e2d2f48/0x710df789068e5ea4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852899.202082:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000004e2d2f48/0x710df789068e5ea4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852899.202093:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000004e2d2f48/0x710df789068e5ea4 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852899.202099:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000004e2d2f48/0x710df789068e5ea4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852899.202104:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000004e2d2f48/0x710df789068e5ea4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787852899.202129:0:5831:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1787852899.524160:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e2c3dcb2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d48a955-7010-4118-9c7d-f396984ae1ff+5:5818:x1874699552293120:12345-0@lo:253: Request processed in 337548us (341921us total) trans 0 rc 0/0 00000100:00100000:2.0:1787852899.524185:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787852899.524287:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b73a24e7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d48a955-7010-4118-9c7d-f396984ae1ff:5818:1874699552293120:0@lo:253: 10000000:01000000:1.0:1787852899.524308:0:5818:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1787852899.524312:0:5818:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787852899.524314:0:5818:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787852899.524315:0:5818:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787852899.524316:0:5818:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:1.0:1787852899.524317:0:5818:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787852899.524318:0:5818:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787852899.524320:0:5818:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787852899.524322:0:5818:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787852899.524323:0:5818:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1787852899.524326:0:5818:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787852899.524328:0:5818:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787852899.524352:0:5818:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000e01c149f from lustre-MDT0000 10000000:01000000:1.0:1787852899.524383:0:5818:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1787852899.524386:0:5818:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1787852899.524391:0:5818:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8f490300cd70 10000000:01000000:1.0:1787852899.524396:0:5818:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787852899.524403:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8f490300cd70 from 1 10000000:01000000:1.0:1787852899.524407:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787852899.524446:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: 000000006423eeec/0x710df789068e5eab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852899.524534:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.101@tcp lock: 000000006423eeec/0x710df789068e5eab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852899.524544:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: 000000006423eeec/0x710df789068e5eab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787852899.524647:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b73a24e7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d48a955-7010-4118-9c7d-f396984ae1ff:5818:1874699552293248:0@lo:101: 00000100:00100000:1.0:1787852899.524693:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787852899.524801:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 000000006c1283f9 going to sleep for 11 seconds 00000100:00100000:0.0:1787852899.524984:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552293248 00000100:00100000:0.0:1787852899.524992:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552293248 00000100:00100000:0.0:1787852899.525081:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787852899.525091:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002df66e5b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+5:5818:x1874699552293248:12345-0@lo:101: 00010000:00010000:0.0:1787852899.525108:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787852899.525127:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004e2d2f48/0x710df789068e5eb2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x710df789068e5eab expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852899.525154:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004e2d2f48/0x710df789068e5eb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x710df789068e5eab expref: 6 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852899.525163:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004e2d2f48/0x710df789068e5eb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x710df789068e5eab expref: 6 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852899.525173:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004e2d2f48, rc 0) 00000100:00100000:0.0:1787852899.525254:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002df66e5b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+6:5818:x1874699552293248:12345-0@lo:101: Request processed in 164us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1787852899.525261:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787852899.525335:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b73a24e7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d48a955-7010-4118-9c7d-f396984ae1ff:5818:1874699552293248:0@lo:101: 00010000:00010000:2.0:1787852899.525351:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: 000000006423eeec/0x710df789068e5eab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e5eb2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787852899.525362:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: 000000006423eeec/0x710df789068e5eab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x710df789068e5eb2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787852899.525413:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d2872a41 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d48a955-7010-4118-9c7d-f396984ae1ff:5818:1874699552293376:0@lo:501: 00000100:00100000:2.0:1787852899.525439:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787852899.525692:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 000000003674fa67 going to sleep for 11 seconds 00000100:00100000:1.0:1787852899.525773:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552293376 00000100:00100000:1.0:1787852899.525779:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552293376 00000100:00100000:1.0:1787852899.525802:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787852899.525807:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000028fec06a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+6:5818:x1874699552293376:12345-0@lo:501: 00000100:00100000:1.0:1787852899.526189:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000028fec06a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+6:5818:x1874699552293376:12345-0@lo:501: Request processed in 381us (749us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787852899.526198:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787852899.526338:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d2872a41 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d48a955-7010-4118-9c7d-f396984ae1ff:5818:1874699552293376:0@lo:501: 10000000:01000000:2.0:1787852899.526378:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.101@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787852899.526439:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: 000000006423eeec/0x710df789068e5eab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e5eb2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787852899.526520:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: 000000006423eeec/0x710df789068e5eab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e5eb2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787852899.526541:0:5818:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8f492abd6000 10000000:01000000:2.0:1787852899.526547:0:5818:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787852899.526551:0:5818:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8f492abd6000 10000000:01000000:2.0:1787852899.526554:0:5818:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1787852899.526557:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8f492abd6000 from 1 10000000:01000000:2.0:1787852899.526560:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1787852899.526617:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: 0000000067e1f9cb/0x710df789068e5eb9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787852899.526625:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.101@tcp lock: 0000000067e1f9cb/0x710df789068e5eb9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787852899.526633:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: 0000000067e1f9cb/0x710df789068e5eb9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787852899.526646:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d2872a41 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d48a955-7010-4118-9c7d-f396984ae1ff:5818:1874699552293504:0@lo:101: 00000100:00100000:2.0:1787852899.526676:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787852899.526699:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 000000003674fa67 going to sleep for 11 seconds 00000100:00100000:0.0:1787852899.526760:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552293504 00000100:00100000:0.0:1787852899.526766:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552293504 00000100:00100000:0.0:1787852899.526808:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787852899.526814:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fe0e59bc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+6:5818:x1874699552293504:12345-0@lo:101: 00010000:00010000:0.0:1787852899.526824:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787852899.526837:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000039eacbdd/0x710df789068e5ec0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x710df789068e5eb9 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852899.526972:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000039eacbdd/0x710df789068e5ec0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x710df789068e5eb9 expref: 7 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852899.526990:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000039eacbdd/0x710df789068e5ec0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x710df789068e5eb9 expref: 7 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852899.526997:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000039eacbdd, rc 0) 00000100:00100000:0.0:1787852899.527041:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fe0e59bc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+7:5818:x1874699552293504:12345-0@lo:101: Request processed in 228us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1787852899.527048:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787852899.527124:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d2872a41 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d48a955-7010-4118-9c7d-f396984ae1ff:5818:1874699552293504:0@lo:101: 00010000:00010000:2.0:1787852899.527134:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: 0000000067e1f9cb/0x710df789068e5eb9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e5ec0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787852899.527142:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: 0000000067e1f9cb/0x710df789068e5eb9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x710df789068e5ec0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787852899.527155:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.101@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1787852899.527263:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: 0000000067e1f9cb/0x710df789068e5eb9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e5ec0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787852899.527280:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: 0000000067e1f9cb/0x710df789068e5eb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e5ec0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787852899.527287:0:5818:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1787852899.527290:0:5818:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787852899.527294:0:5818:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8f492abd6000 10000000:01000000:2.0:1787852899.527296:0:5818:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1787852899.527299:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1787852899.527301:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787852899.527315:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: 00000000f2d29bf1/0x710df789068e5ec7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787852899.527321:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.101@tcp lock: 00000000f2d29bf1/0x710df789068e5ec7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787852899.527327:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: 00000000f2d29bf1/0x710df789068e5ec7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787852899.527336:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d2872a41 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d48a955-7010-4118-9c7d-f396984ae1ff:5818:1874699552293632:0@lo:101: 00000100:00100000:2.0:1787852899.527360:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787852899.527381:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 000000003674fa67 going to sleep for 11 seconds 00000100:00100000:3.0:1787852899.527433:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552293632 00000100:00100000:3.0:1787852899.527437:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552293632 00000100:00100000:3.0:1787852899.527550:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787852899.527557:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f18717b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d48a955-7010-4118-9c7d-f396984ae1ff+7:5818:x1874699552293632:12345-0@lo:101: 00010000:00010000:3.0:1787852899.527565:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787852899.527601:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000044ae9910/0x710df789068e5ece lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x710df789068e5ec7 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852899.527615:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000044ae9910/0x710df789068e5ece lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x710df789068e5ec7 expref: 8 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852899.527623:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000044ae9910/0x710df789068e5ece lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x710df789068e5ec7 expref: 8 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852899.527630:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000044ae9910, rc 0) 00000100:00100000:3.0:1787852899.527669:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f18717b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d48a955-7010-4118-9c7d-f396984ae1ff+8:5818:x1874699552293632:12345-0@lo:101: Request processed in 113us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1787852899.527675:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787852899.527763:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d2872a41 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d48a955-7010-4118-9c7d-f396984ae1ff:5818:1874699552293632:0@lo:101: 00010000:00010000:0.0:1787852899.527775:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: 00000000f2d29bf1/0x710df789068e5ec7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e5ece expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852899.527782:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: 00000000f2d29bf1/0x710df789068e5ec7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x710df789068e5ece expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787852899.527829:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000062de4761 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d48a955-7010-4118-9c7d-f396984ae1ff:5818:1874699552293760:0@lo:501: 00000100:00100000:0.0:1787852899.527935:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787852899.527958:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e819bbd9 going to sleep for 11 seconds 00000100:00100000:0.0:1787852899.527970:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552293760 00000100:00100000:0.0:1787852899.527974:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552293760 00000100:00100000:0.0:1787852899.528006:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787852899.528012:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005bae37ac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+8:5818:x1874699552293760:12345-0@lo:501: 00000100:00100000:0.0:1787852899.528255:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005bae37ac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+9:5818:x1874699552293760:12345-0@lo:501: Request processed in 243us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1787852899.528263:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787852899.528295:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000062de4761 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d48a955-7010-4118-9c7d-f396984ae1ff:5818:1874699552293760:0@lo:501: 00000100:00100000:0.0:1787852899.528323:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000062de4761 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d48a955-7010-4118-9c7d-f396984ae1ff:5818:1874699552293888:0@lo:503: 00000100:00100000:0.0:1787852899.528373:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787852899.528385:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e819bbd9 going to sleep for 11 seconds 00000100:00100000:0.0:1787852899.528398:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552293888 00000100:00100000:0.0:1787852899.528402:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552293888 00000100:00100000:0.0:1787852899.528418:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787852899.528423:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004c8b4227 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+9:5818:x1874699552293888:12345-0@lo:503: 00000100:00100000:0.0:1787852899.528843:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004c8b4227 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+9:5818:x1874699552293888:12345-0@lo:503: Request processed in 418us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1787852899.528861:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787852899.529027:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000062de4761 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d48a955-7010-4118-9c7d-f396984ae1ff:5818:1874699552293888:0@lo:503: 00000100:00100000:0.0:1787852899.529762:0:5859:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000051c57a4a pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d48a955-7010-4118-9c7d-f396984ae1ff:5859:1874699552294016:0@lo:502: 00000100:00100000:0.0:1787852899.529816:0:5859:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787852899.529956:0:5859:0:(client.c:2715:ptlrpc_set_wait()) set 000000009c77f562 going to sleep for 11 seconds 00000100:00100000:2.0:1787852899.529995:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552294016 00000100:00100000:2.0:1787852899.530001:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552294016 00000100:00100000:2.0:1787852899.530080:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787852899.530088:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004c6aa15e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+9:5859:x1874699552294016:12345-0@lo:502: 00000100:00100000:2.0:1787852899.530315:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004c6aa15e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+9:5859:x1874699552294016:12345-0@lo:502: Request processed in 228us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1787852899.530330:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787852899.530425:0:5859:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000051c57a4a pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d48a955-7010-4118-9c7d-f396984ae1ff:5859:1874699552294016:0@lo:502: 00000020:01000000:0.0:1787852899.530516:0:5859:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787852899.530529:0:5859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787852899.530531:0:5859:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787852899.530537:0:5859:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1787852899.530540:0:5859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787852899.530555:0:5859:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (0000000037cddc4c) 00000020:00000080:0.0:1787852899.530591:0:5859:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1787852899.530597:0:5859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1787852899.530677:0:5859:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:0.0:1787852899.530685:0:5859:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x710df789068e5edc 00000020:00000080:0.0:1787852899.531028:0:5859:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1787852899.531033:0:5859:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787852899.531036:0:5859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787852899.531038:0:5859:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787852899.531040:0:5859:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787852899.531044:0:5859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787852899.531051:0:5859:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1787852899.531055:0:5859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787852899.531068:0:5859:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000adc7e85e) 00000020:00000080:0.0:1787852899.531078:0:5859:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1787852899.531082:0:5859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1787852899.531084:0:5859:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1787852899.531087:0:5859:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1787852899.531091:0:5859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787852899.531131:0:5859:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000e01c149f from lustre-MDT0000, refs=3 00000020:00000080:0.0:1787852899.531141:0:5859:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000004caf2380) 00000020:00000080:0.0:1787852899.531148:0:5859:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1787852899.531206:0:5859:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1787852899.531211:0:5859:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x710df789068e5ef1 00000020:00000080:0.0:1787852899.531343:0:5859:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1787852899.531349:0:5859:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1787852899.531353:0:5859:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x710df789068e5ef8 00080000:01000000:0.0:1787852899.531358:0:5859:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:0.0:1787852899.531360:0:5859:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x710df789068e5eff 00080000:10000000:0.0:1787852899.532075:0:5859:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:0.0:1787852899.532752:0:5859:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:0.0:1787852899.538715:0:5859:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:0.0:1787852899.632555:0:5859:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:0.0:1787852899.633319:0:5859:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:1.0:1787852899.636730:0:5859:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:1.0:1787852899.637123:0:5859:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1787852899.670207:0:5859:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000001fe1182e) 00000020:00000080:1.0:1787852899.670233:0:5859:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1787852899.670349:0:5859:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:1.0:1787852899.670358:0:5859:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x710df789068e5f0d 00000020:00000080:0.0:1787852899.671061:0:5859:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:1.0:1787852899.676084:0:5859:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:3.0:1787852899.814849:0:5859:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1787852899.958471:0:5859:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1787852899.988920:0:5859:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:2.0:1787852900.116397:0:5859:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00010000:00010000:3.0:1787852900.138692:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:1.0:1787852900.147277:0:5859:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:3.0:1787852900.200099:0:5859:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x710df789068e5f14 00000020:00000080:3.0:1787852900.203696:0:5859:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1787852900.203713:0:5859:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787852900.203721:0:5859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787852900.203724:0:5859:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1787852900.203727:0:5859:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787852900.203732:0:5859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787852900.203734:0:5859:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787852900.203737:0:5859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787852900.203738:0:5859:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787852900.203741:0:5859:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787852900.203744:0:5859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787852900.203745:0:5859:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:3.0:1787852900.203747:0:5859:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787852900.203934:0:5859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787852900.203937:0:5859:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1787852900.203943:0:5859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1787852900.203995:0:5859:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:3.0:1787852900.204058:0:5859:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000054f01231 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d48a955-7010-4118-9c7d-f396984ae1ff:5859:1874699552294144:0@lo:502: 00000100:00100000:3.0:1787852900.204166:0:5859:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787852900.204248:0:5859:0:(client.c:2715:ptlrpc_set_wait()) set 00000000425fb69b going to sleep for 11 seconds 00000100:00100000:0.0:1787852900.204465:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552294144 00000100:00100000:0.0:1787852900.204473:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552294144 00000100:00100000:0.0:1787852900.204650:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787852900.204659:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007bb7c5d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+9:5859:x1874699552294144:12345-0@lo:502: 00000100:00100000:0.0:1787852900.206354:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007bb7c5d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+9:5859:x1874699552294144:12345-0@lo:502: Request processed in 1686us (2180us total) trans 0 rc 0/0 00000100:00100000:0.0:1787852900.206370:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787852900.206633:0:5859:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000054f01231 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d48a955-7010-4118-9c7d-f396984ae1ff:5859:1874699552294144:0@lo:502: 00000020:01000000:3.0:1787852900.206675:0:5859:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787852900.206682:0:5859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787852900.206685:0:5859:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:3.0:1787852900.206695:0:5859:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:1.0:1787852900.207618:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:1.0:1787852900.207640:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.101@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787852900.207659:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: 00000000f2d29bf1/0x710df789068e5ec7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e5ece expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852900.207670:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: 00000000f2d29bf1/0x710df789068e5ec7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e5ece expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787852900.207677:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8f492abd6000 from 1 10000000:01000000:1.0:1787852900.207680:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787852900.207718:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: 00000000e7f6d39b/0x710df789068e5f1b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852900.207725:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.101@tcp lock: 00000000e7f6d39b/0x710df789068e5f1b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852900.207746:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: 00000000e7f6d39b/0x710df789068e5f1b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787852900.208007:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003bc47f15 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d48a955-7010-4118-9c7d-f396984ae1ff:5818:1874699552294272:0@lo:101: 00000100:00100000:1.0:1787852900.208323:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787852900.208375:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 000000006c1283f9 going to sleep for 11 seconds 00000100:00100000:3.0:1787852900.208453:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552294272 00000100:00100000:3.0:1787852900.208461:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552294272 00000100:00100000:3.0:1787852900.208915:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787852900.208926:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001e69f7ee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+9:5818:x1874699552294272:12345-0@lo:101: 00010000:00010000:3.0:1787852900.208941:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787852900.208956:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f55573f3/0x710df789068e5f22 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x710df789068e5f1b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852900.208978:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f55573f3/0x710df789068e5f22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x710df789068e5f1b expref: 10 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852900.208987:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f55573f3/0x710df789068e5f22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x710df789068e5f1b expref: 10 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852900.208994:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f55573f3, rc 0) 00000100:00100000:3.0:1787852900.209047:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001e69f7ee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+10:5818:x1874699552294272:12345-0@lo:101: Request processed in 125us (727us total) trans 0 rc 0/0 00000100:00100000:1.0:1787852900.209286:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003bc47f15 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d48a955-7010-4118-9c7d-f396984ae1ff:5818:1874699552294272:0@lo:101: 00010000:00010000:1.0:1787852900.209301:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: 00000000e7f6d39b/0x710df789068e5f1b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e5f22 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852900.209309:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: 00000000e7f6d39b/0x710df789068e5f1b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x710df789068e5f22 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787852900.209561:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787852900.215279:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003bc47f15 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d48a955-7010-4118-9c7d-f396984ae1ff:5818:1874699552294400:0@lo:256: 00000100:00100000:1.0:1787852900.215358:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787852900.215547:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 000000006c1283f9 going to sleep for 11 seconds 00000100:00100000:0.0:1787852900.216103:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552294400 00000100:00100000:0.0:1787852900.216112:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552294400 00000100:00100000:0.0:1787852900.216174:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787852900.216182:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000078bdc10d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+10:5818:x1874699552294400:12345-0@lo:256: 20000000:01000000:0.0:1787852900.216203:0:5829:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1787852900.216209:0:5829:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1787852900.216303:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000078bdc10d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+10:5818:x1874699552294400:12345-0@lo:256: Request processed in 122us (945us total) trans 0 rc 0/0 00000100:00100000:0.0:1787852900.216310:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787852900.216516:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003bc47f15 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d48a955-7010-4118-9c7d-f396984ae1ff:5818:1874699552294400:0@lo:256: 10000000:01000000:1.0:1787852900.219906:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787852900.219977:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: 00000000e7f6d39b/0x710df789068e5f1b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e5f22 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852900.219991:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: 00000000e7f6d39b/0x710df789068e5f1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e5f22 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787852900.220098:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f492abd6000 from 1 10000000:01000000:0.0:1787852900.220103:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787852900.220172:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: 0000000004c654aa/0x710df789068e5f29 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852900.220180:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.101@tcp lock: 0000000004c654aa/0x710df789068e5f29 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852900.220190:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: 0000000004c654aa/0x710df789068e5f29 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787852900.220216:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000051c57a4a pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d48a955-7010-4118-9c7d-f396984ae1ff:5818:1874699552294528:0@lo:101: 00000100:00100000:0.0:1787852900.220299:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787852900.220361:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b8c3a244 going to sleep for 11 seconds 00000100:00100000:2.0:1787852900.220440:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552294528 00000100:00100000:2.0:1787852900.220448:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552294528 00000100:00100000:2.0:1787852900.220507:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787852900.220516:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dacc4be3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+10:5818:x1874699552294528:12345-0@lo:101: 00010000:00010000:2.0:1787852900.220529:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787852900.220542:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000eef0fef1/0x710df789068e5f30 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x710df789068e5f29 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787852900.220563:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000eef0fef1/0x710df789068e5f30 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x710df789068e5f29 expref: 11 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787852900.220594:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000eef0fef1/0x710df789068e5f30 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x710df789068e5f29 expref: 11 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787852900.220603:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000eef0fef1, rc 0) 00000100:00100000:2.0:1787852900.220656:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dacc4be3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+11:5818:x1874699552294528:12345-0@lo:101: Request processed in 141us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1787852900.220663:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787852900.220890:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000051c57a4a pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d48a955-7010-4118-9c7d-f396984ae1ff:5818:1874699552294528:0@lo:101: 00010000:00010000:1.0:1787852900.220904:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: 0000000004c654aa/0x710df789068e5f29 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e5f30 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852900.220926:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: 0000000004c654aa/0x710df789068e5f29 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x710df789068e5f30 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787852900.220989:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003bc47f15 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d48a955-7010-4118-9c7d-f396984ae1ff:5818:1874699552294656:0@lo:501: 00000100:00100000:1.0:1787852900.221016:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787852900.221043:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 000000006c1283f9 going to sleep for 11 seconds 00000100:00100000:2.0:1787852900.221163:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552294656 00000100:00100000:2.0:1787852900.221168:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552294656 00000100:00100000:2.0:1787852900.221198:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787852900.221205:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003b27952a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d48a955-7010-4118-9c7d-f396984ae1ff+11:5818:x1874699552294656:12345-0@lo:501: 00000100:00100000:2.0:1787852900.221984:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003b27952a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d48a955-7010-4118-9c7d-f396984ae1ff+11:5818:x1874699552294656:12345-0@lo:501: Request processed in 778us (965us total) trans 0 rc 0/0 00000100:00100000:2.0:1787852900.222003:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787852900.227225:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003bc47f15 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d48a955-7010-4118-9c7d-f396984ae1ff:5818:1874699552294656:0@lo:501: 00000100:00100000:1.0:1787852900.227298:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003bc47f15 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d48a955-7010-4118-9c7d-f396984ae1ff:5818:1874699552294784:0@lo:503: 00000100:00100000:1.0:1787852900.227382:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787852900.227431:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 000000006c1283f9 going to sleep for 11 seconds 00000100:00100000:0.0:1787852900.227499:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552294784 00000100:00100000:0.0:1787852900.227506:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552294784 00000100:00100000:0.0:1787852900.227561:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787852900.227587:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000df0f6e37 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d48a955-7010-4118-9c7d-f396984ae1ff+11:5818:x1874699552294784:12345-0@lo:503: 00000040:00080000:0.0:1787852900.227640:0:5831:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787852900.227689:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000df0f6e37 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d48a955-7010-4118-9c7d-f396984ae1ff+11:5818:x1874699552294784:12345-0@lo:503: Request processed in 120us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1787852900.227704:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787852900.228358:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003bc47f15 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d48a955-7010-4118-9c7d-f396984ae1ff:5818:1874699552294784:0@lo:503: 00000040:00080000:1.0:1787852900.230242:0:5864:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:0.0:1787852900.230416:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1787852900.230441:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787852900.232357:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: 0000000004c654aa/0x710df789068e5f29 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e5f30 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852900.232380:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: 0000000004c654aa/0x710df789068e5f29 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e5f30 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787852900.232476:0:5818:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787852900.232479:0:5818:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8f492abd6000 10000000:01000000:0.0:1787852900.232483:0:5818:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8f492abd6000 10000000:01000000:0.0:1787852900.232499:0:5818:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787852900.232505:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8f492abd6000 from 1 10000000:01000000:0.0:1787852900.232508:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787852900.232544:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: 00000000d3ef436a/0x710df789068e5f37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852900.232551:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.101@tcp lock: 00000000d3ef436a/0x710df789068e5f37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852900.232561:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: 00000000d3ef436a/0x710df789068e5f37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787852900.232618:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f5c8f813 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d48a955-7010-4118-9c7d-f396984ae1ff:5818:1874699552294912:0@lo:101: 00000100:00100000:0.0:1787852900.232682:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787852900.232723:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 000000009c77f562 going to sleep for 11 seconds 00000100:00100000:1.0:1787852900.233326:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552294912 00000100:00100000:1.0:1787852900.233335:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552294912 00000100:00100000:1.0:1787852900.233379:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787852900.233388:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ac84ddf2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+11:5818:x1874699552294912:12345-0@lo:101: 00010000:00010000:1.0:1787852900.233402:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787852900.233419:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f390eb97/0x710df789068e5f3e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x710df789068e5f37 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852900.233445:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f390eb97/0x710df789068e5f3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x710df789068e5f37 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852900.233454:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f390eb97/0x710df789068e5f3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x710df789068e5f37 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852900.233485:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f390eb97, rc 0) 00000100:00100000:1.0:1787852900.233539:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ac84ddf2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+12:5818:x1874699552294912:12345-0@lo:101: Request processed in 151us (856us total) trans 0 rc 0/0 00000100:00100000:1.0:1787852900.233545:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787852900.233651:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f5c8f813 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d48a955-7010-4118-9c7d-f396984ae1ff:5818:1874699552294912:0@lo:101: 00010000:00010000:2.0:1787852900.233665:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: 00000000d3ef436a/0x710df789068e5f37 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e5f3e expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787852900.233673:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: 00000000d3ef436a/0x710df789068e5f37 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x710df789068e5f3e expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787852900.233726:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c667823b pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d48a955-7010-4118-9c7d-f396984ae1ff:5818:1874699552295040:0@lo:501: 00000100:00100000:2.0:1787852900.233750:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787852900.233777:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d28221fb going to sleep for 11 seconds 00000100:00100000:1.0:1787852900.234566:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552295040 00000100:00100000:1.0:1787852900.234592:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552295040 00000100:00100000:1.0:1787852900.234635:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787852900.234642:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ccab6dea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+12:5818:x1874699552295040:12345-0@lo:501: 00000100:00100000:1.0:1787852900.235098:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ccab6dea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+12:5818:x1874699552295040:12345-0@lo:501: Request processed in 456us (1346us total) trans 0 rc 0/0 00000100:00100000:1.0:1787852900.235107:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787852900.235337:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c667823b pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d48a955-7010-4118-9c7d-f396984ae1ff:5818:1874699552295040:0@lo:501: 00000100:00100000:2.0:1787852900.235390:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c667823b pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d48a955-7010-4118-9c7d-f396984ae1ff:5818:1874699552295168:0@lo:503: 00000100:00100000:2.0:1787852900.235440:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787852900.235481:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d28221fb going to sleep for 11 seconds 00000100:00100000:0.0:1787852900.236295:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552295168 00000100:00100000:0.0:1787852900.236305:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552295168 00000100:00100000:0.0:1787852900.236364:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787852900.236372:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003ae62455 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d48a955-7010-4118-9c7d-f396984ae1ff+12:5818:x1874699552295168:12345-0@lo:503: 00000100:00100000:0.0:1787852900.236799:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003ae62455 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d48a955-7010-4118-9c7d-f396984ae1ff+12:5818:x1874699552295168:12345-0@lo:503: Request processed in 426us (1358us total) trans 0 rc 0/0 00000100:00100000:0.0:1787852900.236807:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787852900.237109:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c667823b pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d48a955-7010-4118-9c7d-f396984ae1ff:5818:1874699552295168:0@lo:503: 00000100:00100000:2.0:1787852900.237404:0:5865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c667823b pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d48a955-7010-4118-9c7d-f396984ae1ff:5865:1874699552295296:0@lo:502: 00000100:00100000:2.0:1787852900.237448:0:5865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787852900.237476:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552295296 00000100:00100000:2.0:1787852900.237481:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552295296 00000100:00100000:2.0:1787852900.237637:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787852900.237643:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000540c1f1c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+12:5865:x1874699552295296:12345-0@lo:502: 00000100:00100000:2.0:1787852900.238349:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000540c1f1c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+12:5865:x1874699552295296:12345-0@lo:502: Request processed in 704us (899us total) trans 0 rc 0/0 00000100:00100000:2.0:1787852900.238358:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787852900.238425:0:5865:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c98efa3b going to sleep for 11 seconds 00000100:00100000:2.0:1787852900.238444:0:5865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c667823b pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d48a955-7010-4118-9c7d-f396984ae1ff:5865:1874699552295296:0@lo:502: 00000020:01000004:2.0:1787852900.238519:0:5865:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1787852900.238537:0:5865:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000f9214902) 00000020:00000080:2.0:1787852900.238559:0:5865:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:2.0:1787852900.238659:0:5865:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000e01c149f from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787852900.238663:0:5865:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000e01c149f from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787852900.238666:0:5865:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000e01c149f 4 00010000:00080000:2.0:1787852900.238695:0:5865:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000729f4c69@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.101@tcp at head 00010000:00010000:2.0:1787852900.253897:0:5865:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:2.0:1787852900.254396:0:5865:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1787852900.254436:0:5865:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787852900.254451:0:5865:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x710df789068e5f4c 00000100:00080000:2.0:1787852900.254462:0:5865:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787852900.254468:0:5865:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000729f4c69 using connection 192.168.204.101@tcp/0@lo 00000100:00100000:2.0:1787852900.254607:0:5865:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000c667823b x1874699552295424/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787852900.254629:0:5865:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787852900.254727:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c667823b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874699552295424:0@lo:38: 00000100:00100000:1.0:1787852900.254823:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787852900.257331:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552295424 00000100:00100000:2.0:1787852900.257348:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552295424 00000100:00100000:2.0:1787852900.257403:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787852900.257411:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003bc47f15 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3305:x1874699552295424:12345-0@lo:38: 00000100:00100000:2.0:1787852900.257539:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003bc47f15 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3305:x1874699552295424:12345-0@lo:38: Request processed in 127us (2715us total) trans 0 rc -11/-11 00000100:00100000:2.0:1787852900.257546:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787852900.257631:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787852900.257638:0:3305:0:(import.c:65:import_set_state_nolock()) 00000000729f4c69 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787852900.257643:0:3305:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1787852900.257661:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c667823b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874699552295424:0@lo:38: 00000100:00100000:2.0:1787852900.258122:0:5865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c667823b pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d48a955-7010-4118-9c7d-f396984ae1ff:5865:1874699552295552:0@lo:502: 00000100:00100000:2.0:1787852900.258271:0:5865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787852900.258303:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552295552 00000100:00100000:2.0:1787852900.258307:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552295552 00000100:00100000:2.0:1787852900.258353:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787852900.258361:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007a9a1dc4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+12:5865:x1874699552295552:12345-0@lo:502: 00000100:00100000:2.0:1787852900.259431:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007a9a1dc4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+12:5865:x1874699552295552:12345-0@lo:502: Request processed in 1066us (1155us total) trans 0 rc 0/0 00000100:00100000:2.0:1787852900.259442:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787852900.259546:0:5865:0:(client.c:2715:ptlrpc_set_wait()) set 00000000284cc816 going to sleep for 11 seconds 00000100:00100000:2.0:1787852900.259591:0:5865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c667823b pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d48a955-7010-4118-9c7d-f396984ae1ff:5865:1874699552295552:0@lo:502: 00000040:00080000:2.0:1787852900.259627:0:5865:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:3.0:1787852900.262469:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:3.0:1787852900.262509:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787852900.262525:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: 00000000d3ef436a/0x710df789068e5f37 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e5f3e expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852900.262540:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: 00000000d3ef436a/0x710df789068e5f37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e5f3e expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787852900.262618:0:5818:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787852900.262621:0:5818:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787852900.262622:0:5818:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787852900.262631:0:5818:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787852900.262632:0:5818:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787852900.262633:0:5818:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787852900.262634:0:5818:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787852900.262635:0:5818:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787852900.262637:0:5818:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787852900.262638:0:5818:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787852900.262639:0:5818:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787852900.262640:0:5818:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787852900.262643:0:5818:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:3.0:1787852900.262645:0:5818:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787852900.262646:0:5818:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787852900.262647:0:5818:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787852900.262648:0:5818:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787852900.262649:0:5818:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787852900.262649:0:5818:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787852900.262650:0:5818:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787852900.262651:0:5818:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787852900.262652:0:5818:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787852900.262653:0:5818:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787852900.262653:0:5818:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787852900.262654:0:5818:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787852900.262684:0:5818:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1787852900.262719:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000054f01231 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d48a955-7010-4118-9c7d-f396984ae1ff:5818:1874699552295680:0@lo:253: 00000100:00100000:3.0:1787852900.262799:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787852900.262982:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 0000000088a02850 going to sleep for 11 seconds 00000100:00100000:1.0:1787852900.263557:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552295680 00000100:00100000:1.0:1787852900.263565:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552295680 00000100:00100000:1.0:1787852900.263641:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787852900.263649:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000082f39986 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d48a955-7010-4118-9c7d-f396984ae1ff+12:5818:x1874699552295680:12345-0@lo:253: 20000000:01000000:1.0:1787852900.263680:0:5831:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1787852900.263694:0:5831:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1787852900.340283:0:5831:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787852900.340308:0:5831:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1787852900.340380:0:5852:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787852900.340386:0:5852:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787852900.340411:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000004ad68a5f/0x710df789068e5f53 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852900.340431:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000f55573f3/0x710df789068e5f22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x710df789068e5f1b expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852900.340439:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000004ad68a5f/0x710df789068e5f53 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852900.340487:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000f55573f3/0x710df789068e5f22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x710df789068e5f1b expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852900.340504:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000f55573f3/0x710df789068e5f22 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x710df789068e5f1b expref: 12 pid: 5830 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787852900.340520:0:5852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009abf208f pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5852:1874699552295808:0@lo:104: 00000100:00100000:0.0:1787852900.340634:0:5852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787852900.340701:0:5852:0:(client.c:2715:ptlrpc_set_wait()) set 000000001d335b23 going to sleep for 11 seconds 00000100:00100000:1.0:1787852900.341187:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552295808 00000100:00100000:1.0:1787852900.341196:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552295808 00000100:00100000:1.0:1787852900.341293:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787852900.341305:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f2ec1e35 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5d48a955-7010-4118-9c7d-f396984ae1ff+3:5852:x1874699552295808:12345-0@lo:104: 00010000:00010000:1.0:1787852900.341321:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.101@tcp lock: 00000000e7f6d39b/0x710df789068e5f1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x710df789068e5f22 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852900.341414:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787852900.341421:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f2ec1e35 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5d48a955-7010-4118-9c7d-f396984ae1ff+3:5852:x1874699552295808:12345-0@lo:104: Request processed in 118us (787us total) trans 0 rc 0/0 00000100:00100000:1.0:1787852900.341429:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1787852900.341453:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787852900.341458:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.101@tcp lock: 00000000e7f6d39b/0x710df789068e5f1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x710df789068e5f22 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852900.341466:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e7f6d39b already unused, calling callback (00000000daf0e5e9) 10000000:00010000:1.0:1787852900.341470:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.101@tcp lock: 00000000e7f6d39b/0x710df789068e5f1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x710df789068e5f22 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852900.341478:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.101@tcp lock: 00000000e7f6d39b/0x710df789068e5f1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x710df789068e5f22 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787852900.341486:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.101@tcp lock: 00000000e7f6d39b/0x710df789068e5f1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x710df789068e5f22 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787852900.341491:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787852900.341525:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.101@tcp lock: 00000000e7f6d39b/0x710df789068e5f1b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x710df789068e5f22 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852900.341531:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787852900.341549:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.101@tcp lock: 00000000e7f6d39b/0x710df789068e5f1b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x710df789068e5f22 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852900.341556:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.101@tcp lock: 00000000e7f6d39b/0x710df789068e5f1b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x710df789068e5f22 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852900.341615:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787852900.341617:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787852900.341619:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787852900.341683:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000096cb3503 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5d48a955-7010-4118-9c7d-f396984ae1ff:3307:1874699552295936:0@lo:103: 00000100:00100000:1.0:1787852900.341717:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787852900.342059:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552295936 00000100:00100000:1.0:1787852900.342064:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552295936 00010000:00010000:1.0:1787852900.342083:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000f55573f3/0x710df789068e5f22 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x710df789068e5f1b expref: 13 pid: 5830 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787852900.342113:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787852900.342121:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fe664036 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d48a955-7010-4118-9c7d-f396984ae1ff+13:3307:x1874699552295936:12345-0@lo:103: 00010000:00010000:1.0:1787852900.342132:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787852900.342137:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000f55573f3/0x710df789068e5f22 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x710df789068e5f1b expref: 13 pid: 5830 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852900.342147:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000f55573f3/0x710df789068e5f22 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x710df789068e5f1b expref: 13 pid: 5830 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852900.342165:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000004ad68a5f/0x710df789068e5f53 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852900.342172:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004ad68a5f/0x710df789068e5f53 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787852900.342185:0:5822:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001800328s 00010000:00010000:1.0:1787852900.342188:0:5822:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000004ad68a5f/0x710df789068e5f53 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852900.342203:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000004ad68a5f/0x710df789068e5f53 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852900.342208:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000004ad68a5f/0x710df789068e5f53 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852900.342214:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000004ad68a5f/0x710df789068e5f53 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852900.342219:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000004ad68a5f already unused, calling callback (00000000ee1a6bb8) 00010000:00010000:1.0:1787852900.342222:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000004ad68a5f/0x710df789068e5f53 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852900.342257:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000004ad68a5f/0x710df789068e5f53 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852900.342266:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000004ad68a5f/0x710df789068e5f53 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852900.342275:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787852900.342306:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fe664036 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d48a955-7010-4118-9c7d-f396984ae1ff+13:3307:x1874699552295936:12345-0@lo:103: Request processed in 186us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1787852900.342313:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1787852900.348980:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f55573f3/0x710df789068e5f22 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x710df789068e5f1b expref: 12 pid: 5830 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787852900.349007:0:5852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009abf208f pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5852:1874699552295808:0@lo:104: 00010000:00010000:2.0:1787852900.349033:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000004ad68a5f/0x710df789068e5f53 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787852900.349043:0:5852:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000004ad68a5f/0x710df789068e5f53 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787852900.349048:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000004ad68a5f/0x710df789068e5f53 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787852900.349053:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000004ad68a5f/0x710df789068e5f53 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787852900.352699:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000096cb3503 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5d48a955-7010-4118-9c7d-f396984ae1ff:3307:1874699552295936:0@lo:103: 00000100:00100000:1.0:1787852900.417703:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000082f39986 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d48a955-7010-4118-9c7d-f396984ae1ff+11:5818:x1874699552295680:12345-0@lo:253: Request processed in 154045us (154895us total) trans 0 rc 0/0 00000100:00100000:1.0:1787852900.417720:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787852900.419021:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000054f01231 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d48a955-7010-4118-9c7d-f396984ae1ff:5818:1874699552295680:0@lo:253: 10000000:01000000:3.0:1787852900.419044:0:5818:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1787852900.419047:0:5818:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787852900.419049:0:5818:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787852900.419050:0:5818:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787852900.419052:0:5818:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787852900.419053:0:5818:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787852900.419054:0:5818:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787852900.419056:0:5818:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787852900.419057:0:5818:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787852900.419059:0:5818:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787852900.419060:0:5818:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787852900.419081:0:5818:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787852900.419083:0:5818:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787852900.419104:0:5818:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1787852900.434467:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1787852900.436157:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1787852900.436434:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1787852900.438175:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1787852900.438513:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1787852900.438721:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1787852900.441323:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1787852900.441516:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1787852900.443393:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1787852900.444933:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1787852900.445260:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1787852900.446168:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:0.0:1787852900.579255:0:5818:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:1.0:1787852900.718142:0:5818:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1787852900.718408:0:5870:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:2.0:1787852900.718412:0:5870:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:1.0:1787852900.718607:0:5871:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1787852900.739404:0:5818:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1787852900.739713:0:5818:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1787852900.740133:0:5818:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1787852900.740140:0:5818:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1787852900.741453:0:5818:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787852900.744177:0:5818:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1787852900.747651:0:5818:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1787852900.747739:0:5818:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1787852900.750849:0:5818:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1787852900.755392:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:3.0:1787852900.758605:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1787852900.758774:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1787852900.758922:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1787852900.759050:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1787852900.759192:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1787852900.759366:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1787852900.760273:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1787852900.760444:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1787852900.760622:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1787852900.760844:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1787852900.761006:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1787852900.761147:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1787852900.761356:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1787852900.761531:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1787852900.761788:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1787852900.761957:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1787852900.762343:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1787852900.762493:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1787852900.762705:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1787852900.762878:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1787852900.763041:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1787852900.763138:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1787852900.763318:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1787852900.763418:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1787852900.763516:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1787852900.763693:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1787852900.763850:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1787852900.764004:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1787852900.764164:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1787852900.764316:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1787852900.764483:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1787852900.764701:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1787852900.764911:0:5818:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:0.0:1787852900.833333:0:5871:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:0.0:1787852900.971740:0:5818:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1787852900.971806:0:5818:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffff9a7d01df3988 00100000:10000000:0.0:1787852900.971815:0:5818:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1787852900.977441:0:5818:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787852900.977462:0:5818:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.101@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787852900.977490:0:5818:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1787852900.977517:0:5818:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:3.0:1787852901.058477:0:5871:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1787852901.058566:0:5871:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 1, retries 0 00000004:00080000:3.0:1787852901.058601:0:5871:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:3.0:1787852901.164543:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787852902.192120:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787852903.211502:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787852904.236502:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787852905.259358:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787852905.706553:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 00000100:00080000:0.0:1787852905.706561:0:475:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 10000000:01000000:2.0:1787852905.706563:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8f492abd6000 from 3 00000100:00080000:0.0:1787852905.706589:0:475:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 10000000:01000000:2.0:1787852905.706592:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00000100:00080000:0.0:1787852905.706593:0:475:0:(import.c:65:import_set_state_nolock()) 00000000729f4c69 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787852905.706608:0:475:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000729f4c69 using connection 192.168.204.101@tcp/0@lo 00010000:00010000:2.0:1787852905.706632:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: 00000000983d8f65/0x710df789068e5f5a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787852905.706634:0:475:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000069eb7f58 x1874699552296320/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:2.0:1787852905.706653:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.101@tcp lock: 00000000983d8f65/0x710df789068e5f5a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787852905.706665:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: 00000000983d8f65/0x710df789068e5f5a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787852905.706702:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a19942ea pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552296192:0@lo:101: 00000100:00100000:2.0:1787852905.706783:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787852905.706785:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787852905.706798:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000175338bf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5d48a955-7010-4118-9c7d-f396984ae1ff:3309:1874699552296064:0@lo:400: 00000100:00100000:0.0:1787852905.706840:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787852905.706843:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b16d07f6 going to sleep for 11 seconds 00000100:00100000:0.0:1787852905.706883:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552296192 00000100:00100000:0.0:1787852905.706891:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552296192 00000100:00100000:2.0:1787852905.706903:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000069eb7f58 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874699552296320:0@lo:38: 00000100:00100000:2.0:1787852905.706936:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787852905.706945:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552296064 00000100:00100000:0.0:1787852905.706950:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552296064 00000100:00100000:0.0:1787852905.706975:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787852905.706985:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000054f6be pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+12:5834:x1874699552296192:12345-0@lo:101: 00000100:00100000:2.0:1787852905.706988:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552296320 00000100:00100000:2.0:1787852905.706994:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552296320 00010000:00010000:0.0:1787852905.706998:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787852905.707014:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000029086426/0x710df789068e5f61 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x710df789068e5f5a expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787852905.707022:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787852905.707029:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005ccae740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3305:x1874699552296320:12345-0@lo:38: 00010000:00010000:0.0:1787852905.707042:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000029086426/0x710df789068e5f61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x710df789068e5f5a expref: 13 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:2.0:1787852905.707053:0:5838:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 225 last 0 00010000:00010000:0.0:1787852905.707055:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000029086426/0x710df789068e5f61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x710df789068e5f5a expref: 13 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852905.707068:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000029086426, rc 0) 00000020:00000080:2.0:1787852905.707093:0:5838:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x710df789068e5f68 00000100:00100000:0.0:1787852905.707145:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000054f6be pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+13:5834:x1874699552296192:12345-0@lo:101: Request processed in 161us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1787852905.707154:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000004:00100000:2.0:1787852905.707159:0:5838:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:0.0:1787852905.707188:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00080000:2.0:1787852905.707291:0:5838:0:(import.c:65:import_set_state_nolock()) 000000001fc89e92 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787852905.707335:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005ccae740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874699552296320:12345-0@lo:38: Request processed in 304us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1787852905.707343:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787852905.707379:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000069eb7f58 x1874699552296320/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787852915 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787852905.707394:0:3305:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1787852905.707402:0:3305:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1787852905.707406:0:3305:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787852905.707408:0:3305:0:(import.c:65:import_set_state_nolock()) 00000000729f4c69 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787852905.707413:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000069eb7f58 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874699552296320:0@lo:38: 00000100:00100000:2.0:1787852905.707439:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a19942ea pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552296192:0@lo:101: 00010000:00010000:2.0:1787852905.707461:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: 00000000983d8f65/0x710df789068e5f5a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e5f61 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787852905.707469:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: 00000000983d8f65/0x710df789068e5f5a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x710df789068e5f61 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787852905.707512:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a19942ea pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552296448:0@lo:256: 00000100:00100000:0.0:1787852905.707521:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bc15b751 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+12:3309:x1874699552296064:12345-0@lo:400: 00000100:00100000:2.0:1787852905.707549:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787852905.707563:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b16d07f6 going to sleep for 11 seconds 00000100:00100000:0.0:1787852905.707591:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bc15b751 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+12:3309:x1874699552296064:12345-0@lo:400: Request processed in 375us (731us total) trans 0 rc 0/0 00000100:00100000:0.0:1787852905.707599:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787852905.707620:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552296448 00000100:00100000:0.0:1787852905.707624:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552296448 00000100:00100000:0.0:1787852905.707640:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787852905.707650:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000767ac531 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+12:5834:x1874699552296448:12345-0@lo:256: 20000000:01000000:0.0:1787852905.707664:0:5829:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787852905.707683:0:5829:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787852905.707687:0:5829:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1787852905.707764:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000767ac531 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+12:5834:x1874699552296448:12345-0@lo:256: Request processed in 118us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1787852905.707770:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787852905.707803:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000175338bf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5d48a955-7010-4118-9c7d-f396984ae1ff:3309:1874699552296064:0@lo:400: 00000100:00100000:2.0:1787852905.709453:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a19942ea pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552296448:0@lo:256: 10000000:01000000:2.0:1787852905.709525:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787852905.709534:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: 00000000983d8f65/0x710df789068e5f5a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e5f61 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787852905.709542:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: 00000000983d8f65/0x710df789068e5f5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e5f61 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852906.283189:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787852907.310085:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787852907.470022:0:6114:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg401-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787852908.329891:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787852909.354133:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787852910.378929:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787852910.826890:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000edd27e12 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5d48a955-7010-4118-9c7d-f396984ae1ff:3309:1874699552296576:0@lo:400: 00000100:00100000:0.0:1787852910.826967:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787852910.827042:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787852910.827049:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e6998d9c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874699552296704:0@lo:400: 00000100:00100000:0.0:1787852910.827078:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787852910.827121:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552296576 00000100:00100000:0.0:1787852910.827127:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552296576 00000100:00100000:0.0:1787852910.827166:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787852910.827172:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002c36e42e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+12:3309:x1874699552296576:12345-0@lo:400: 00000100:00100000:0.0:1787852910.827213:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002c36e42e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+12:3309:x1874699552296576:12345-0@lo:400: Request processed in 42us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1787852910.827220:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787852910.827261:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000edd27e12 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5d48a955-7010-4118-9c7d-f396984ae1ff:3309:1874699552296576:0@lo:400: 00000100:00100000:0.0:1787852910.827308:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552296704 00000100:00100000:0.0:1787852910.827311:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552296704 00000100:00100000:0.0:1787852910.827334:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787852910.827338:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000afe9f1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874699552296704:12345-0@lo:400: 00000100:00100000:0.0:1787852910.827369:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000afe9f1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874699552296704:12345-0@lo:400: Request processed in 31us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1787852910.827374:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787852910.827394:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000e6998d9c x1874699552296704/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787852926 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787852910.827406:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e6998d9c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874699552296704:0@lo:400: 00010000:00010000:2.0:1787852911.408851:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787852912.425861:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787852913.412455:0:6316:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff673eb8e0 20000000:00000080:2.0:1787852913.412476:0:6316:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8f493c159800 uarg=0000000000000000 20000000:01000000:2.0:1787852913.412515:0:6316:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1787852913.412523:0:6316:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1787852913.412528:0:6316:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1787852913.413406:0:6316:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:2.0:1787852913.413420:0:6316:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:2.0:1787852913.422468:0:6316:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787852913.423382:0:6316:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1787852913.423464:0:6316:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:2.0:1787852913.423517:0:6316:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:2.0:1787852913.423537:0:6316:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787852913.423556:0:6316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000000685a601/0x710df789068e5f6f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787852913.424060:0:6316:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000eef0fef1/0x710df789068e5f30 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x710df789068e5f29 expref: 11 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787852913.424069:0:6316:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000000685a601/0x710df789068e5f6f lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787852913.424111:0:6316:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000eef0fef1/0x710df789068e5f30 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x710df789068e5f29 expref: 11 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787852913.424126:0:6316:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000eef0fef1/0x710df789068e5f30 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x710df789068e5f29 expref: 11 pid: 5830 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787852913.424141:0:6316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000043e144eb pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6316:1874699552296832:0@lo:104: 00000100:00100000:2.0:1787852913.424209:0:6316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787852913.424330:0:6316:0:(client.c:2715:ptlrpc_set_wait()) set 0000000004a30221 going to sleep for 11 seconds 00000100:00100000:1.0:1787852913.431460:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552296832 00000100:00100000:1.0:1787852913.431474:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552296832 00000100:00100000:1.0:1787852913.431601:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787852913.431611:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c91c08bd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5d48a955-7010-4118-9c7d-f396984ae1ff+3:6316:x1874699552296832:12345-0@lo:104: 00010000:00010000:1.0:1787852913.431631:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.101@tcp lock: 0000000004c654aa/0x710df789068e5f29 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x710df789068e5f30 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852913.431734:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787852913.431740:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c91c08bd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5d48a955-7010-4118-9c7d-f396984ae1ff+3:6316:x1874699552296832:12345-0@lo:104: Request processed in 131us (7531us total) trans 0 rc 0/0 00000100:00100000:1.0:1787852913.431747:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787852913.431826:0:6316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000043e144eb pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6316:1874699552296832:0@lo:104: 00010000:00010000:3.0:1787852913.431852:0:6316:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000000685a601/0x710df789068e5f6f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852913.432962:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787852913.432985:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.101@tcp lock: 0000000004c654aa/0x710df789068e5f29 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x710df789068e5f30 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852913.432997:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000004c654aa already unused, calling callback (00000000daf0e5e9) 10000000:00010000:0.0:1787852913.433001:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.101@tcp lock: 0000000004c654aa/0x710df789068e5f29 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x710df789068e5f30 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852913.433034:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.101@tcp lock: 0000000004c654aa/0x710df789068e5f29 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x710df789068e5f30 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787852913.433041:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.101@tcp lock: 0000000004c654aa/0x710df789068e5f29 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x710df789068e5f30 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787852913.433047:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787852913.433108:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.101@tcp lock: 0000000004c654aa/0x710df789068e5f29 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x710df789068e5f30 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852913.433115:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787852913.433140:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.101@tcp lock: 0000000004c654aa/0x710df789068e5f29 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x710df789068e5f30 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852913.433146:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.101@tcp lock: 0000000004c654aa/0x710df789068e5f29 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x710df789068e5f30 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852913.433167:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787852913.433169:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787852913.433171:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787852913.433188:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000175338bf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5d48a955-7010-4118-9c7d-f396984ae1ff:3307:1874699552296960:0@lo:103: 00000100:00100000:0.0:1787852913.433241:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787852913.436991:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552296960 00000100:00100000:0.0:1787852913.437006:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552296960 00010000:00010000:0.0:1787852913.437050:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000eef0fef1/0x710df789068e5f30 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x710df789068e5f29 expref: 12 pid: 5830 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787852913.437104:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787852913.437113:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000027b96829 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d48a955-7010-4118-9c7d-f396984ae1ff+12:3307:x1874699552296960:12345-0@lo:103: 00010000:00010000:0.0:1787852913.437145:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787852913.437151:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000eef0fef1/0x710df789068e5f30 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x710df789068e5f29 expref: 12 pid: 5830 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852913.437163:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000eef0fef1/0x710df789068e5f30 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x710df789068e5f29 expref: 12 pid: 5830 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852913.437212:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000eef0fef1/0x710df789068e5f30 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x710df789068e5f29 expref: 12 pid: 5830 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852913.437232:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000000685a601/0x710df789068e5f6f lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852913.437240:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000685a601/0x710df789068e5f6f lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852913.437258:0:5822:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000000685a601/0x710df789068e5f6f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852913.437264:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000000685a601/0x710df789068e5f6f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852913.437270:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000000685a601/0x710df789068e5f6f lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852913.437291:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000000685a601/0x710df789068e5f6f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852913.437297:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000000685a601 already unused, calling callback (00000000ee1a6bb8) 00010000:00010000:0.0:1787852913.437300:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000000685a601/0x710df789068e5f6f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852913.437318:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000000685a601/0x710df789068e5f6f lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852913.437332:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000000685a601/0x710df789068e5f6f lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852913.437346:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787852913.437428:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000027b96829 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d48a955-7010-4118-9c7d-f396984ae1ff+11:3307:x1874699552296960:12345-0@lo:103: Request processed in 317us (4187us total) trans 0 rc 0/0 00000100:00100000:0.0:1787852913.437435:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787852913.437483:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000175338bf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5d48a955-7010-4118-9c7d-f396984ae1ff:3307:1874699552296960:0@lo:103: 00010000:00010000:3.0:1787852913.437744:0:6316:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000000685a601/0x710df789068e5f6f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852913.437760:0:6316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000000685a601/0x710df789068e5f6f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852913.437766:0:6316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000000685a601/0x710df789068e5f6f lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852913.450256:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787852914.481998:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787852915.498160:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787852915.949454:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000be43e5b9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874699552297216:0@lo:400: 00000100:00100000:2.0:1787852915.949532:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787852915.949620:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787852915.949626:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008a2e7f30 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5d48a955-7010-4118-9c7d-f396984ae1ff:3309:1874699552297088:0@lo:400: 00000100:00100000:2.0:1787852915.949656:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787852915.950167:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552297088 00000100:00100000:0.0:1787852915.950175:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552297088 00000100:00100000:0.0:1787852915.950239:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787852915.950248:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000053e1e3cf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d48a955-7010-4118-9c7d-f396984ae1ff+11:3309:x1874699552297088:12345-0@lo:400: 00000100:00100000:0.0:1787852915.950314:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000053e1e3cf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d48a955-7010-4118-9c7d-f396984ae1ff+11:3309:x1874699552297088:12345-0@lo:400: Request processed in 69us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1787852915.950322:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787852915.951133:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008a2e7f30 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5d48a955-7010-4118-9c7d-f396984ae1ff:3309:1874699552297088:0@lo:400: 00000100:00100000:2.0:1787852915.951205:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552297216 00000100:00100000:2.0:1787852915.951210:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552297216 00000100:00100000:3.0:1787852915.952436:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787852915.952448:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000043e144eb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874699552297216:12345-0@lo:400: 00000100:00100000:3.0:1787852915.952601:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000043e144eb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874699552297216:12345-0@lo:400: Request processed in 155us (3069us total) trans 0 rc 0/0 00000100:00100000:3.0:1787852915.952609:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787852915.953086:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000be43e5b9 x1874699552297216/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787852931 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787852915.953133:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000be43e5b9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874699552297216:0@lo:400: 00010000:00010000:3.0:1787852916.526824:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787852917.550611:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787852918.569775:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787852919.594946:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787852920.565169:0:6679:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787852920.565174:0:6679:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1787852920.565337:0:6679:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000006a39e52c 00000020:01000004:2.0:1787852920.565358:0:6679:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1787852920.565373:0:6679:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1787852920.565392:0:6679:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (00000000ea7f5caf) 00000020:00000080:2.0:1787852920.565411:0:6679:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787852920.591986:0:6679:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1787852920.592242:0:6679:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00010000:00010000:3.0:1787852920.617903:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1787852920.619456:0:6679:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1787852920.624159:0:6679:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1787852920.624197:0:6679:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1787852920.624258:0:6679:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1787852920.624287:0:6679:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1787852920.624888:0:6679:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1787852920.624900:0:6679:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787852920.624914:0:6679:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x710df789068e5f7d 00000020:01000004:3.0:1787852920.624924:0:6679:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1787852920.624963:0:6679:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.101@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787852920.624967:0:6679:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.101@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787852920.624974:0:6679:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1787852920.624980:0:6679:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1787852920.625001:0:6679:0:(genops.c:413:class_newdev()) Allocate new device OSS (000000003b61dbd5) 00000020:00000080:3.0:1787852920.625018:0:6679:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:3.0:1787852920.626350:0:6679:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787852920.626532:0:6679:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1787852920.626544:0:6679:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1787852920.627238:0:6679:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1787852920.627246:0:6679:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1787852920.644691:0:6679:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1787852920.644717:0:6679:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1787852920.651694:0:6679:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787852920.652650:0:6679:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1787852920.652673:0:6679:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1787852920.662164:0:6679:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1787852920.662183:0:6679:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1787852920.726338:0:6679:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787852920.726698:0:6679:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1787852920.726705:0:6679:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1787852920.730295:0:6679:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1787852920.730318:0:6679:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1787852920.734390:0:6679:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1787852920.734419:0:6679:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1787852920.744355:0:6679:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787852920.748910:0:6679:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1787852920.748930:0:6679:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1787852920.753657:0:6679:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1787852920.753690:0:6679:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1787852920.865621:0:6679:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787852920.866050:0:6679:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1787852920.866057:0:6679:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1787852920.869139:0:6679:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1787852920.869165:0:6679:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1787852920.869790:0:6679:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1787852920.869813:0:6679:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1787852920.869819:0:6679:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.101@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1787852920.895365:0:6679:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.101@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787852920.895405:0:6679:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.101@tcp, index=0000, flags=0x20062 00000020:01000004:3.0:1787852920.895409:0:6679:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787852920.895411:0:6679:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787852920.895412:0:6679:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787852920.895413:0:6679:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787852920.895414:0:6679:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787852920.895415:0:6679:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787852920.895417:0:6679:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787852920.895418:0:6679:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787852920.895420:0:6679:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787852920.895422:0:6679:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787852920.895423:0:6679:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787852920.895427:0:6679:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:3.0:1787852920.895429:0:6679:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787852920.895431:0:6679:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787852920.895432:0:6679:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787852920.895433:0:6679:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787852920.895434:0:6679:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787852920.895439:0:6679:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787852920.895440:0:6679:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787852920.895440:0:6679:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787852920.895441:0:6679:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787852920.895442:0:6679:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787852920.895443:0:6679:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787852920.895472:0:6679:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1787852920.895492:0:6679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000055bbba06 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d48a955-7010-4118-9c7d-f396984ae1ff:6679:1874699552297344:0@lo:253: 00000100:00100000:3.0:1787852920.898068:0:6679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787852920.898269:0:6679:0:(client.c:2715:ptlrpc_set_wait()) set 000000009ebe13cd going to sleep for 11 seconds 00000100:00100000:0.0:1787852920.903006:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552297344 00000100:00100000:0.0:1787852920.903027:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552297344 00000100:00100000:0.0:1787852920.903147:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787852920.903159:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000daf0e1cf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+11:6679:x1874699552297344:12345-0@lo:253: 20000000:01000000:0.0:1787852920.903232:0:5830:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1787852920.903238:0:5830:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:0.0:1787852920.903244:0:5830:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:0.0:1787852920.903254:0:5830:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:0.0:1787852920.906467:0:5830:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787852920.907100:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:0.0:1787852920.910890:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:0.0:1787852920.911081:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:0.0:1787852920.911090:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:0.0:1787852920.911123:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:0.0:1787852920.911244:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:0.0:1787852920.915154:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:0.0:1787852920.915199:0:5830:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.101@tcp 20000000:01000000:0.0:1787852920.915202:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.101@tcp (null) (null) (null) 00000040:00080000:0.0:1787852920.915241:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:0.0:1787852920.915250:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1787852920.915329:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:0.0:1787852920.915337:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.204.101@tcp (null) (null) 00000040:00080000:0.0:1787852920.915390:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:0.0:1787852920.915400:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1787852920.915441:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:0.0:1787852920.915520:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:1.0:1787852920.919475:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:1.0:1787852920.919517:0:5830:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.101@tcp 20000000:01000000:1.0:1787852920.919520:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.101@tcp (null) (null) (null) 00000040:00080000:1.0:1787852920.919960:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:1.0:1787852920.919971:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1787852920.920008:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:1.0:1787852920.920016:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.204.101@tcp (null) (null) 00000040:00080000:1.0:1787852920.920078:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:1.0:1787852920.920094:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1787852920.920130:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:1.0:1787852920.920164:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:1.0:1787852920.920182:0:5830:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:1.0:1787852920.920186:0:5830:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:1.0:1787852920.920193:0:5830:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1787852920.920194:0:5830:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1787852920.920196:0:5830:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1787852920.920211:0:5830:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787852920.920215:0:5830:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1787852920.920254:0:5830:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1787852920.920258:0:5830:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787852920.926116:0:6694:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:3.0:1787852920.926259:0:6694:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:3.0:1787852920.926330:0:6694:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:1.0:1787852920.927194:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:1.0:1787852920.927237:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:1.0:1787852920.927405:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:1.0:1787852920.927419:0:5830:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1787852920.927422:0:5830:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787852920.928363:0:6695:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1787852920.928427:0:6695:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1787852920.928476:0:6695:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:1.0:1787852920.929087:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:1.0:1787852920.929189:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:1.0:1787852920.929224:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:1.0:1787852920.929236:0:5830:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1787852920.929239:0:5830:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1787852920.932906:0:6696:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:1.0:1787852920.933988:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:1.0:1787852920.934044:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:1.0:1787852920.934133:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 10000000:01000000:1.0:1787852920.934156:0:5830:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1787852920.934176:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000f2ae8b31/0x710df789068e5f8b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852920.934198:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000004e2d2f48/0x710df789068e5eb2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x710df789068e5eab expref: 11 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852920.934205:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000044ae9910/0x710df789068e5ece lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x710df789068e5ec7 expref: 11 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852920.934231:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000f390eb97/0x710df789068e5f3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x710df789068e5f37 expref: 11 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852920.934238:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000f2ae8b31/0x710df789068e5f8b lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852920.935347:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000f390eb97/0x710df789068e5f3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x710df789068e5f37 expref: 11 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852920.935369:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000f390eb97/0x710df789068e5f3e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x710df789068e5f37 expref: 11 pid: 5830 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787852920.935384:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dace8d2a pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5830:1874699552297472:0@lo:104: 00000100:00100000:1.0:1787852920.935458:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787852920.935634:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000044ae9910/0x710df789068e5ece lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x710df789068e5ec7 expref: 11 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852920.935642:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000044ae9910/0x710df789068e5ece lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x710df789068e5ec7 expref: 11 pid: 5831 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787852920.935651:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ac6234f1 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5830:1874699552297600:0@lo:104: 00000100:00100000:1.0:1787852920.935676:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787852920.936933:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000004e2d2f48/0x710df789068e5eb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x710df789068e5eab expref: 11 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852920.936948:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000004e2d2f48/0x710df789068e5eb2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x710df789068e5eab expref: 11 pid: 5830 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787852920.936960:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000edd27e12 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5830:1874699552297728:0@lo:104: 00000100:00100000:1.0:1787852920.937022:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787852920.937094:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552297472 00000100:00100000:2.0:1787852920.937391:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552297472 00000100:00100000:2.0:1787852920.937449:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552297600 00000100:00100000:2.0:1787852920.937454:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552297600 00000100:00100000:2.0:1787852920.937472:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787852920.937481:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f0c5bdc5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5d48a955-7010-4118-9c7d-f396984ae1ff+4:5830:x1874699552297472:12345-0@lo:104: 00010000:00010000:2.0:1787852920.937500:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.101@tcp lock: 00000000d3ef436a/0x710df789068e5f37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x710df789068e5f3e expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787852920.937613:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787852920.937619:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f0c5bdc5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5d48a955-7010-4118-9c7d-f396984ae1ff+4:5830:x1874699552297472:12345-0@lo:104: Request processed in 140us (2163us total) trans 0 rc 0/0 00000100:00100000:2.0:1787852920.937627:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787852920.937647:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787852920.937652:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e6998d9c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5d48a955-7010-4118-9c7d-f396984ae1ff+3:5830:x1874699552297600:12345-0@lo:104: 00010000:00010000:2.0:1787852920.937659:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.101@tcp lock: 00000000f2d29bf1/0x710df789068e5ec7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x710df789068e5ece expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787852920.937694:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787852920.937698:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e6998d9c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5d48a955-7010-4118-9c7d-f396984ae1ff+3:5830:x1874699552297600:12345-0@lo:104: Request processed in 48us (2022us total) trans 0 rc 0/0 00000100:00100000:2.0:1787852920.937704:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1787852920.937720:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787852920.937727:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.101@tcp lock: 00000000d3ef436a/0x710df789068e5f37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x710df789068e5f3e expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787852920.937736:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d3ef436a already unused, calling callback (00000000daf0e5e9) 10000000:00010000:2.0:1787852920.937739:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.101@tcp lock: 00000000d3ef436a/0x710df789068e5f37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x710df789068e5f3e expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787852920.937747:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.101@tcp lock: 00000000d3ef436a/0x710df789068e5f37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x710df789068e5f3e expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787852920.937764:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.101@tcp lock: 00000000d3ef436a/0x710df789068e5f37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x710df789068e5f3e expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787852920.937772:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787852920.937819:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.101@tcp lock: 00000000d3ef436a/0x710df789068e5f37 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x710df789068e5f3e expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787852920.937835:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787852920.937858:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.101@tcp lock: 00000000d3ef436a/0x710df789068e5f37 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x710df789068e5f3e expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787852920.937865:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.101@tcp lock: 00000000d3ef436a/0x710df789068e5f37 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x710df789068e5f3e expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787852920.937880:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787852920.937883:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.101@tcp lock: 00000000f2d29bf1/0x710df789068e5ec7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x710df789068e5ece expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787852920.937888:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f2d29bf1 already unused, calling callback (00000000daf0e5e9) 10000000:00010000:2.0:1787852920.937890:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.101@tcp lock: 00000000f2d29bf1/0x710df789068e5ec7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x710df789068e5ece expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787852920.937895:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.101@tcp lock: 00000000f2d29bf1/0x710df789068e5ec7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x710df789068e5ece expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787852920.937900:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.101@tcp lock: 00000000f2d29bf1/0x710df789068e5ec7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x710df789068e5ece expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787852920.937906:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787852920.937916:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.101@tcp lock: 00000000f2d29bf1/0x710df789068e5ec7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x710df789068e5ece expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787852920.937922:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787852920.937926:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.101@tcp lock: 00000000f2d29bf1/0x710df789068e5ec7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x710df789068e5ece expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787852920.937946:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.101@tcp lock: 00000000f2d29bf1/0x710df789068e5ec7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x710df789068e5ece expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787852920.937957:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787852920.937959:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787852920.937960:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787852920.937971:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787852920.937975:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8f492abd6000 from 21 10000000:01000000:2.0:1787852920.937978:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787852920.937999:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: 0000000058622f24/0x710df789068e5f92 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787852920.938008:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.101@tcp lock: 0000000058622f24/0x710df789068e5f92 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787852920.938016:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: 0000000058622f24/0x710df789068e5f92 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787852920.938032:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c667823b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552298112:0@lo:101: 00000100:00100000:2.0:1787852920.938065:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787852920.938090:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d06e6817 going to sleep for 11 seconds 00010000:00010000:3.0:1787852920.938154:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787852920.942928:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552298112 00000100:00100000:1.0:1787852920.942949:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552298112 00000100:00100000:1.0:1787852920.943028:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787852920.943038:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000000924b66 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+12:5834:x1874699552298112:12345-0@lo:101: 00010000:00010000:1.0:1787852920.943057:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787852920.943077:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008e4a4033/0x710df789068e5f99 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x710df789068e5f92 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852920.943106:0:5829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000f2ae8b31/0x710df789068e5f8b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852920.943115:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000008e4a4033/0x710df789068e5f99 lrc: 4/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x710df789068e5f92 expref: 13 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852920.943134:0:5829:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: MGS lock: 00000000f2ae8b31/0x710df789068e5f8b lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852920.943145:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008e4a4033/0x710df789068e5f99 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x710df789068e5f92 expref: 13 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852920.943154:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008e4a4033, rc 0) 00000100:00100000:1.0:1787852920.943217:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000000924b66 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+13:5834:x1874699552298112:12345-0@lo:101: Request processed in 179us (5151us total) trans 0 rc 0/0 00000100:00100000:1.0:1787852920.943224:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787852920.943431:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c667823b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552298112:0@lo:101: 00010000:00010000:1.0:1787852920.943454:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGC192.168.204.101@tcp lock: 0000000058622f24/0x710df789068e5f92 lrc: 4/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e5f99 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852920.943481:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGC192.168.204.101@tcp lock: 0000000058622f24/0x710df789068e5f92 lrc: 4/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x710df789068e5f99 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787852920.943517:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e819bbd9 going to sleep for 11 seconds 00000100:00100000:1.0:1787852920.943532:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dace8d2a pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5830:1874699552297472:0@lo:104: 00000100:00100000:1.0:1787852920.943541:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ac6234f1 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5830:1874699552297600:0@lo:104: 00000100:00100000:0.0:1787852920.943743:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552297728 00000100:00100000:0.0:1787852920.943750:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552297728 00000100:00100000:1.0:1787852920.943855:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000be43e5b9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5d48a955-7010-4118-9c7d-f396984ae1ff:3306:1874699552297856:0@lo:103: 00000100:00100000:1.0:1787852920.943899:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787852920.943940:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787852920.943946:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a19942ea pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5d48a955-7010-4118-9c7d-f396984ae1ff:3306:1874699552297984:0@lo:103: 00000100:00100000:1.0:1787852920.943968:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787852920.943998:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552297856 00000100:00100000:1.0:1787852920.944001:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552297856 00010000:00010000:1.0:1787852920.944022:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000f390eb97/0x710df789068e5f3e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x710df789068e5f37 expref: 13 pid: 5830 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787852920.944043:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552297984 00000100:00100000:1.0:1787852920.944046:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552297984 00010000:00010000:1.0:1787852920.944058:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000044ae9910/0x710df789068e5ece lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x710df789068e5ec7 expref: 14 pid: 5831 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787852920.944071:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787852920.944077:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b73a24e7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5d48a955-7010-4118-9c7d-f396984ae1ff+14:3306:x1874699552297856:12345-0@lo:103: 00010000:00010000:1.0:1787852920.944087:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787852920.944092:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000f390eb97/0x710df789068e5f3e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x710df789068e5f37 expref: 14 pid: 5830 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852920.944117:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000f390eb97/0x710df789068e5f3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x710df789068e5f37 expref: 14 pid: 5830 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852920.944134:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f390eb97/0x710df789068e5f3e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x710df789068e5f37 expref: 14 pid: 5830 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852920.944148:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787852920.944177:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b73a24e7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5d48a955-7010-4118-9c7d-f396984ae1ff+13:3306:x1874699552297856:12345-0@lo:103: Request processed in 101us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1787852920.944184:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787852920.944200:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787852920.944205:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000021650ef8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5d48a955-7010-4118-9c7d-f396984ae1ff+12:3306:x1874699552297984:12345-0@lo:103: 00010000:00010000:1.0:1787852920.944213:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787852920.944216:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000044ae9910/0x710df789068e5ece lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x710df789068e5ec7 expref: 12 pid: 5831 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852920.944225:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000044ae9910/0x710df789068e5ece lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x710df789068e5ec7 expref: 12 pid: 5831 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852920.944235:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000044ae9910/0x710df789068e5ece lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x710df789068e5ec7 expref: 12 pid: 5831 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852920.944247:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787852920.944281:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000021650ef8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5d48a955-7010-4118-9c7d-f396984ae1ff+11:3306:x1874699552297984:12345-0@lo:103: Request processed in 76us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1787852920.944287:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787852920.944311:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a19942ea pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5d48a955-7010-4118-9c7d-f396984ae1ff:3306:1874699552297984:0@lo:103: 00000100:00100000:1.0:1787852920.944319:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000be43e5b9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5d48a955-7010-4118-9c7d-f396984ae1ff:3306:1874699552297856:0@lo:103: 00000100:00100000:2.0:1787852920.945145:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787852920.945160:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000096cb3503 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5d48a955-7010-4118-9c7d-f396984ae1ff+3:5830:x1874699552297728:12345-0@lo:104: 00010000:00010000:2.0:1787852920.945174:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.101@tcp lock: 000000006423eeec/0x710df789068e5eab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x710df789068e5eb2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787852920.945254:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787852920.945260:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000096cb3503 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5d48a955-7010-4118-9c7d-f396984ae1ff+3:5830:x1874699552297728:12345-0@lo:104: Request processed in 107us (8239us total) trans 0 rc 0/0 00000100:00100000:2.0:1787852920.945276:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1787852920.945393:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787852920.945400:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.101@tcp lock: 000000006423eeec/0x710df789068e5eab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x710df789068e5eb2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852920.945409:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006423eeec already unused, calling callback (00000000daf0e5e9) 10000000:00010000:3.0:1787852920.945412:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.101@tcp lock: 000000006423eeec/0x710df789068e5eab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x710df789068e5eb2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852920.945419:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.101@tcp lock: 000000006423eeec/0x710df789068e5eab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x710df789068e5eb2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787852920.945424:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.101@tcp lock: 000000006423eeec/0x710df789068e5eab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x710df789068e5eb2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787852920.945430:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787852920.945472:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.101@tcp lock: 000000006423eeec/0x710df789068e5eab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x710df789068e5eb2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852920.945479:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787852920.945513:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.101@tcp lock: 000000006423eeec/0x710df789068e5eab lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x710df789068e5eb2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852920.945520:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.101@tcp lock: 000000006423eeec/0x710df789068e5eab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x710df789068e5eb2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852920.945538:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787852920.945540:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787852920.945542:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787852920.945550:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787852920.945631:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000054f01231 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5d48a955-7010-4118-9c7d-f396984ae1ff:3309:1874699552298240:0@lo:103: 00000100:00100000:3.0:1787852920.945669:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787852920.945716:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552298240 00000100:00100000:3.0:1787852920.945723:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552298240 00010000:00010000:3.0:1787852920.945748:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000004e2d2f48/0x710df789068e5eb2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x710df789068e5eab expref: 11 pid: 5830 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787852920.945784:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787852920.945790:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003fa3eb9d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5d48a955-7010-4118-9c7d-f396984ae1ff+11:3309:x1874699552298240:12345-0@lo:103: 00010000:00010000:3.0:1787852920.945802:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787852920.945806:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000004e2d2f48/0x710df789068e5eb2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x710df789068e5eab expref: 11 pid: 5830 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852920.945815:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000004e2d2f48/0x710df789068e5eb2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x710df789068e5eab expref: 11 pid: 5830 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852920.945843:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000f2ae8b31/0x710df789068e5f8b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40290400000020 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852920.945857:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f2ae8b31/0x710df789068e5f8b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40290400000020 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852920.945879:0:5823:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000f2ae8b31/0x710df789068e5f8b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852920.945885:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000f2ae8b31/0x710df789068e5f8b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000020 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852920.945891:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000f2ae8b31/0x710df789068e5f8b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000020 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852920.945896:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000f2ae8b31/0x710df789068e5f8b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852920.945901:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f2ae8b31 already unused, calling callback (00000000ee1a6bb8) 00010000:00010000:3.0:1787852920.945906:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000f2ae8b31/0x710df789068e5f8b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852920.945913:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000f2ae8b31/0x710df789068e5f8b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000020 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852920.945921:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000008e4a4033/0x710df789068e5f99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40080000000000 nid: 0@lo remote: 0x710df789068e5f92 expref: 11 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852920.945927:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008e4a4033/0x710df789068e5f99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40080000000000 nid: 0@lo remote: 0x710df789068e5f92 expref: 11 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852920.945947:0:5823:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: MGS lock: 000000008e4a4033/0x710df789068e5f99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x710df789068e5f92 expref: 11 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787852920.945967:0:5823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000b8f9d0b pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:MGS:5823:1874699552298368:0@lo:105: 00000100:00100000:3.0:1787852920.945993:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787852920.946011:0:5823:0:(client.c:2715:ptlrpc_set_wait()) set 000000005ba56859 going to sleep for 11 seconds 00000100:00100000:3.0:1787852920.946051:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552298368 00000100:00100000:3.0:1787852920.946055:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552298368 00000100:00100000:3.0:1787852920.946076:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787852920.946082:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000908a8774 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5d48a955-7010-4118-9c7d-f396984ae1ff+3:5823:x1874699552298368:12345-0@lo:105: 00010000:00010000:3.0:1787852920.946090:0:5820:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: MGC192.168.204.101@tcp lock: 0000000058622f24/0x710df789068e5f92 lrc: 5/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x710df789068e5f99 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852920.946097:0:5820:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: MGC192.168.204.101@tcp lock: 0000000058622f24/0x710df789068e5f92 lrc: 5/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x710df789068e5f99 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852920.946106:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGC192.168.204.101@tcp lock: 0000000058622f24/0x710df789068e5f92 lrc: 5/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11080000000000 nid: local remote: 0x710df789068e5f99 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852920.946111:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: 0000000058622f24/0x710df789068e5f92 lrc: 6/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11080000000000 nid: local remote: 0x710df789068e5f99 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852920.946117:0:5820:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: MGC192.168.204.101@tcp lock: 0000000058622f24/0x710df789068e5f92 lrc: 6/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1080000000000 nid: local remote: 0x710df789068e5f99 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852920.946143:0:5820:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock 0000000058622f24) 00000100:00100000:3.0:1787852920.946173:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000908a8774 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5d48a955-7010-4118-9c7d-f396984ae1ff+3:5823:x1874699552298368:12345-0@lo:105: Request processed in 91us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1787852920.946180:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787852920.946214:0:5823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000b8f9d0b pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:MGS:5823:1874699552298368:0@lo:105: 00010000:00010000:3.0:1787852920.946236:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000f2ae8b31/0x710df789068e5f8b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852920.946244:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787852920.946285:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003fa3eb9d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5d48a955-7010-4118-9c7d-f396984ae1ff+11:3309:x1874699552298240:12345-0@lo:103: Request processed in 496us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1787852920.946291:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787852920.946313:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000054f01231 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5d48a955-7010-4118-9c7d-f396984ae1ff:3309:1874699552298240:0@lo:103: 00010000:00010000:1.0:1787852920.946607:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: MGC192.168.204.101@tcp lock: 0000000058622f24/0x710df789068e5f92 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x710df789068e5f99 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852920.946616:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: 0000000058622f24/0x710df789068e5f92 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x710df789068e5f99 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787852920.946700:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d9a84c93 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552298496:0@lo:501: 00000100:00100000:1.0:1787852920.946733:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787852920.946762:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set 000000004a0bf0f0 going to sleep for 11 seconds 00010000:00010000:1.0:1787852920.946791:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000004e2d2f48/0x710df789068e5eb2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x710df789068e5eab expref: 10 pid: 5830 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787852920.946804:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000edd27e12 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5830:1874699552297728:0@lo:104: 00010000:00010000:1.0:1787852920.946837:0:5830:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000f2ae8b31/0x710df789068e5f8b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852920.946844:0:5830:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000f2ae8b31/0x710df789068e5f8b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852920.946850:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000f2ae8b31/0x710df789068e5f8b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852920.946856:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f2ae8b31/0x710df789068e5f8b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787852920.946866:0:5830:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1787852920.947040:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552298496 00000100:00100000:3.0:1787852920.947046:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552298496 00000100:00100000:3.0:1787852920.947081:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787852920.947088:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005df37ea5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d48a955-7010-4118-9c7d-f396984ae1ff+10:5834:x1874699552298496:12345-0@lo:501: 00000100:00100000:3.0:1787852920.947218:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005df37ea5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d48a955-7010-4118-9c7d-f396984ae1ff+10:5834:x1874699552298496:12345-0@lo:501: Request processed in 130us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1787852920.947224:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787852920.958947:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d9a84c93 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552298496:0@lo:501: 00000100:00100000:1.0:1787852920.959023:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d9a84c93 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552298624:0@lo:503: 00000100:00100000:1.0:1787852920.959350:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787852920.959407:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set 000000004a0bf0f0 going to sleep for 11 seconds 00000100:00100000:2.0:1787852920.959804:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552298624 00000100:00100000:2.0:1787852920.959812:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552298624 00000100:00100000:2.0:1787852920.959875:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787852920.959885:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000072895cda pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d48a955-7010-4118-9c7d-f396984ae1ff+10:5834:x1874699552298624:12345-0@lo:503: 00000100:00100000:2.0:1787852920.960095:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000072895cda pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d48a955-7010-4118-9c7d-f396984ae1ff+10:5834:x1874699552298624:12345-0@lo:503: Request processed in 211us (745us total) trans 0 rc 0/0 00000100:00100000:2.0:1787852920.960103:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787852920.960551:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d9a84c93 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552298624:0@lo:503: 00000100:00100000:1.0:1787852920.960943:0:6697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d9a84c93 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d48a955-7010-4118-9c7d-f396984ae1ff:6697:1874699552298752:0@lo:502: 00000100:00100000:1.0:1787852920.960994:0:6697:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787852920.961022:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552298752 00000100:00100000:1.0:1787852920.961027:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552298752 00000100:00100000:1.0:1787852920.961054:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787852920.961060:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a2744ba0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d48a955-7010-4118-9c7d-f396984ae1ff+10:6697:x1874699552298752:12345-0@lo:502: 00000100:00100000:1.0:1787852920.961534:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a2744ba0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d48a955-7010-4118-9c7d-f396984ae1ff+10:6697:x1874699552298752:12345-0@lo:502: Request processed in 472us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1787852920.961542:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787852920.962923:0:6697:0:(client.c:2715:ptlrpc_set_wait()) set 000000004a0bf0f0 going to sleep for 11 seconds 00000100:00100000:1.0:1787852920.962952:0:6697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d9a84c93 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d48a955-7010-4118-9c7d-f396984ae1ff:6697:1874699552298752:0@lo:502: 00000100:00100000:1.0:1787852920.963017:0:6697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d9a84c93 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d48a955-7010-4118-9c7d-f396984ae1ff:6697:1874699552298880:0@lo:502: 00000100:00100000:1.0:1787852920.963065:0:6697:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787852920.963095:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552298880 00000100:00100000:1.0:1787852920.963101:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552298880 00000100:00100000:1.0:1787852920.966961:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787852920.966983:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004a49712e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d48a955-7010-4118-9c7d-f396984ae1ff+10:6697:x1874699552298880:12345-0@lo:502: 00000100:00100000:1.0:1787852920.970061:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004a49712e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d48a955-7010-4118-9c7d-f396984ae1ff+10:6697:x1874699552298880:12345-0@lo:502: Request processed in 3076us (6985us total) trans 0 rc 0/0 00000100:00100000:1.0:1787852920.970082:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787852920.970174:0:6697:0:(client.c:2715:ptlrpc_set_wait()) set 00000000551d2ca9 going to sleep for 11 seconds 00000100:00100000:1.0:1787852920.970210:0:6697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d9a84c93 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d48a955-7010-4118-9c7d-f396984ae1ff:6697:1874699552298880:0@lo:502: 00000040:00080000:1.0:1787852920.971450:0:6697:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:1.0:1787852920.973407:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:1.0:1787852920.973681:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787852920.973696:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: 0000000058622f24/0x710df789068e5f92 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e5f99 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852920.973709:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: 0000000058622f24/0x710df789068e5f92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e5f99 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787852920.973722:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1787852920.973725:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:1.0:1787852920.973729:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787852920.974722:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: 00000000f2ae8b31/0x710df789068e5fa0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852920.974736:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.101@tcp lock: 00000000f2ae8b31/0x710df789068e5fa0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852920.974747:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: 00000000f2ae8b31/0x710df789068e5fa0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787852920.975153:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d9a84c93 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552299008:0@lo:101: 00000100:00100000:1.0:1787852920.975229:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787852920.975539:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552299008 00000100:00100000:2.0:1787852920.975549:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552299008 00000100:00100000:1.0:1787852920.975719:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set 00000000598ad7d2 going to sleep for 11 seconds 00000100:00100000:2.0:1787852920.975994:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787852920.976004:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dab79a4f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d48a955-7010-4118-9c7d-f396984ae1ff+10:5834:x1874699552299008:12345-0@lo:101: 00010000:00010000:2.0:1787852920.976018:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787852920.976036:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f2d29bf1/0x710df789068e5fa7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x710df789068e5fa0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787852920.976063:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f2d29bf1/0x710df789068e5fa7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x710df789068e5fa0 expref: 11 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787852920.976074:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f2d29bf1/0x710df789068e5fa7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x710df789068e5fa0 expref: 11 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787852920.976084:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f2d29bf1, rc 0) 00000100:00100000:2.0:1787852920.976151:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dab79a4f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d48a955-7010-4118-9c7d-f396984ae1ff+11:5834:x1874699552299008:12345-0@lo:101: Request processed in 149us (923us total) trans 0 rc 0/0 00000100:00100000:2.0:1787852920.976157:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787852920.976271:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d9a84c93 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552299008:0@lo:101: 00010000:00010000:1.0:1787852920.976285:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: 00000000f2ae8b31/0x710df789068e5fa0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e5fa7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852920.976295:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: 00000000f2ae8b31/0x710df789068e5fa0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x710df789068e5fa7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787852920.976364:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d9a84c93 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552299136:0@lo:501: 00000100:00100000:1.0:1787852920.976392:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787852920.986018:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set 00000000598ad7d2 going to sleep for 11 seconds 00000100:00100000:3.0:1787852920.986376:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552299136 00000100:00100000:3.0:1787852920.986389:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552299136 00000100:00100000:3.0:1787852920.988906:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787852920.988922:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008aeb039d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+11:5834:x1874699552299136:12345-0@lo:501: 00000100:00100000:3.0:1787852920.989399:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008aeb039d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+11:5834:x1874699552299136:12345-0@lo:501: Request processed in 480us (13005us total) trans 0 rc 0/0 00000100:00100000:3.0:1787852920.989408:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787852921.000636:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d9a84c93 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552299136:0@lo:501: 00000100:00100000:2.0:1787852921.000833:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ebfa134c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552299264:0@lo:503: 00000100:00100000:2.0:1787852921.000930:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787852921.000991:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set 000000006da803c4 going to sleep for 11 seconds 00000100:00100000:1.0:1787852921.001124:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552299264 00000100:00100000:1.0:1787852921.001132:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552299264 00000100:00100000:1.0:1787852921.001186:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787852921.001195:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000670e3d4f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+11:5834:x1874699552299264:12345-0@lo:503: 00000100:00100000:1.0:1787852921.001629:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000670e3d4f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+11:5834:x1874699552299264:12345-0@lo:503: Request processed in 435us (699us total) trans 0 rc 0/0 00000100:00100000:1.0:1787852921.001638:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787852921.009217:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ebfa134c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552299264:0@lo:503: 00000100:00100000:2.0:1787852921.010527:0:6698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d2872a41 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d48a955-7010-4118-9c7d-f396984ae1ff:6698:1874699552299392:0@lo:502: 00000100:00100000:2.0:1787852921.010659:0:6698:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787852921.010713:0:6698:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ac95e6a3 going to sleep for 11 seconds 00000100:00100000:1.0:1787852921.010891:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552299392 00000100:00100000:1.0:1787852921.010899:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552299392 00000100:00100000:1.0:1787852921.010953:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787852921.010963:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000009a06f22 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+11:6698:x1874699552299392:12345-0@lo:502: 00000100:00100000:1.0:1787852921.011246:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000009a06f22 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+11:6698:x1874699552299392:12345-0@lo:502: Request processed in 285us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1787852921.011263:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787852921.011599:0:6698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d2872a41 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d48a955-7010-4118-9c7d-f396984ae1ff:6698:1874699552299392:0@lo:502: 00000020:01000000:0.0:1787852921.011640:0:6698:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787852921.011650:0:6698:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1787852921.011658:0:6698:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787852921.011661:0:6698:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1787852921.011666:0:6698:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787852921.011670:0:6698:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.101@tcp to nid 0x20000c0a8cc65 (192.168.204.101@tcp) 00000020:01000000:0.0:1787852921.011697:0:6698:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1787852921.011709:0:6698:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787852921.011724:0:6698:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (00000000661ed95e) 00000020:00000080:0.0:1787852921.011747:0:6698:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osp with refcount 2 00000020:00000080:0.0:1787852921.011763:0:6698:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787852921.011872:0:6698:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1787852921.011878:0:6698:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:0.0:1787852921.011885:0:6698:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x710df789068e5fb5 00010000:00080000:0.0:1787852921.011921:0:6698:0:(ldlm_lib.c:102:import_set_conn()) imp 000000002310de23@lustre-OST0000-osc-MDT0000: add connection 192.168.204.101@tcp at head 00010000:00010000:0.0:1787852921.012236:0:6698:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000100:00100000:3.0:1787852921.067685:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000054f01231 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874699552299520:0@lo:400: 00000100:00100000:3.0:1787852921.067857:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787852921.079729:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552299520 00000100:00100000:3.0:1787852921.079746:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552299520 00000100:00100000:3.0:1787852921.080373:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787852921.080414:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000b8f9d0b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874699552299520:12345-0@lo:400: 00000100:00100000:3.0:1787852921.080532:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000b8f9d0b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874699552299520:12345-0@lo:400: Request processed in 121us (12676us total) trans 0 rc 0/0 00000100:00100000:3.0:1787852921.080539:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787852921.080617:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000054f01231 x1874699552299520/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787852937 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787852921.080633:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000054f01231 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874699552299520:0@lo:400: 00000040:01000000:3.0:1787852921.114507:0:6698:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1787852921.114539:0:6698:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1787852921.116040:0:6698:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787852921.116285:0:6698:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787852921.116365:0:6698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:3.0:1787852921.116465:0:6698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1787852921.131968:0:6700:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787852921.131984:0:6700:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1787852921.145712:0:6698:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787852921.145730:0:6698:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787852921.146536:0:6698:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1787852921.146598:0:6698:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x710df789068e5fbc 00000100:00080000:0.0:1787852921.146615:0:6698:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787852921.146622:0:6698:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import 000000002310de23 using connection 192.168.204.101@tcp/0@lo 00000100:00100000:0.0:1787852921.146668:0:6698:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000069eb7f58 x1874699552299648/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787852921.146703:0:6698:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1787852921.148074:0:6698:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787852921.148885:0:6698:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787852921.148890:0:6698:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1787852921.148897:0:6698:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787852921.148903:0:6698:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787852921.148904:0:6698:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787852921.148907:0:6698:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787852921.148909:0:6698:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1787852921.148954:0:6698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000028296dd1 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d48a955-7010-4118-9c7d-f396984ae1ff:6698:1874699552299776:0@lo:502: 00000100:00100000:0.0:1787852921.149051:0:6698:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787852921.149118:0:6698:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c400c589 going to sleep for 11 seconds 00000100:00100000:1.0:1787852921.150054:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552299776 00000100:00100000:1.0:1787852921.150064:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552299776 00000100:00100000:1.0:1787852921.150112:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787852921.150121:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009bf01c0e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+11:6698:x1874699552299776:12345-0@lo:502: 00000100:00100000:1.0:1787852921.150402:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009bf01c0e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+11:6698:x1874699552299776:12345-0@lo:502: Request processed in 281us (1352us total) trans 0 rc 0/0 00000100:00100000:1.0:1787852921.150410:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787852921.150490:0:6698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000028296dd1 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d48a955-7010-4118-9c7d-f396984ae1ff:6698:1874699552299776:0@lo:502: 00000020:01000000:1.0:1787852921.150524:0:6698:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787852921.150530:0:6698:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787852921.150534:0:6698:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787852921.150538:0:6698:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:1.0:1787852921.150711:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:1.0:1787852921.150729:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.101@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787852921.150743:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: 00000000f2ae8b31/0x710df789068e5fa0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e5fa7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787852921.150905:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000069eb7f58 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1874699552299648:0@lo:8: 00000100:00100000:2.0:1787852921.150955:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787852921.152608:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: 00000000f2ae8b31/0x710df789068e5fa0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e5fa7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787852921.152627:0:5834:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787852921.152631:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f492abd6000 from 1 10000000:01000000:1.0:1787852921.152635:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787852921.152681:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: 00000000f390eb97/0x710df789068e5fc3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852921.152689:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.101@tcp lock: 00000000f390eb97/0x710df789068e5fc3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852921.152698:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: 00000000f390eb97/0x710df789068e5fc3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787852921.152719:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000edd27e12 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552299904:0@lo:101: 00000100:00100000:1.0:1787852921.152861:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787852921.152898:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set 0000000005564124 going to sleep for 11 seconds 00000100:00100000:1.0:1787852921.152933:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552299648 00000100:00100000:1.0:1787852921.152940:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552299648 00000100:00100000:1.0:1787852921.153245:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787852921.153269:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000098a810ef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3305:x1874699552299648:12345-0@lo:8: 00010000:00020000:1.0:1787852921.153291:0:6681:0:(ldlm_lib.c:1200:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787852921.153351:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000098a810ef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3305:x1874699552299648:12345-0@lo:8: Request processed in 80us (2394us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787852921.153358:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787852921.153379:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552299904 00000100:00100000:1.0:1787852921.153383:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552299904 00000100:00100000:1.0:1787852921.154183:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787852921.154190:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000005358683 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+11:5834:x1874699552299904:12345-0@lo:101: 00010000:00010000:1.0:1787852921.154203:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787852921.154218:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e7f6d39b/0x710df789068e5fca lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x710df789068e5fc3 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852921.154243:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e7f6d39b/0x710df789068e5fca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x710df789068e5fc3 expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852921.154255:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e7f6d39b/0x710df789068e5fca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x710df789068e5fc3 expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852921.154264:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e7f6d39b, rc 0) 00000100:00100000:1.0:1787852921.154315:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000005358683 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+12:5834:x1874699552299904:12345-0@lo:101: Request processed in 125us (1454us total) trans 0 rc 0/0 00000100:00100000:1.0:1787852921.154321:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:1.0:1787852921.154384:0:3305:0:(import.c:65:import_set_state_nolock()) 000000002310de23 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787852921.154390:0:3305:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787852921.154393:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000069eb7f58 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1874699552299648:0@lo:8: 00000100:00100000:3.0:1787852921.154599:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000edd27e12 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552299904:0@lo:101: 00010000:00010000:3.0:1787852921.154618:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: 00000000f390eb97/0x710df789068e5fc3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e5fca expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852921.154628:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: 00000000f390eb97/0x710df789068e5fc3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x710df789068e5fca expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787852921.154724:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000054f01231 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552300032:0@lo:501: 00000100:00100000:3.0:1787852921.154771:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787852921.154810:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set 0000000030aafaae going to sleep for 11 seconds 00000100:00100000:0.0:1787852921.154931:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552300032 00000100:00100000:0.0:1787852921.154943:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552300032 00000100:00100000:0.0:1787852921.154975:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787852921.154981:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d32e98a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+12:5834:x1874699552300032:12345-0@lo:501: 00000100:00100000:0.0:1787852921.155264:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d32e98a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+12:5834:x1874699552300032:12345-0@lo:501: Request processed in 283us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1787852921.155272:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787852921.158982:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000054f01231 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552300032:0@lo:501: 00000100:00100000:3.0:1787852921.159054:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000054f01231 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552300160:0@lo:503: 00000100:00100000:3.0:1787852921.159145:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787852921.159184:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set 0000000030aafaae going to sleep for 11 seconds 00000100:00100000:3.0:1787852921.159211:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552300160 00000100:00100000:3.0:1787852921.159218:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552300160 00000100:00100000:3.0:1787852921.159264:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787852921.159274:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fa9015cf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+12:5834:x1874699552300160:12345-0@lo:503: 00000100:00100000:3.0:1787852921.159952:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fa9015cf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+12:5834:x1874699552300160:12345-0@lo:503: Request processed in 677us (805us total) trans 0 rc 0/0 00000100:00100000:3.0:1787852921.159961:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787852921.160012:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000054f01231 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552300160:0@lo:503: 00000100:00100000:1.0:1787852921.165115:0:6702:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ac6234f1 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d48a955-7010-4118-9c7d-f396984ae1ff:6702:1874699552300288:0@lo:502: 00000100:00100000:1.0:1787852921.165215:0:6702:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787852921.165347:0:6702:0:(client.c:2715:ptlrpc_set_wait()) set 00000000551d2ca9 going to sleep for 11 seconds 00000100:00100000:3.0:1787852921.168507:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552300288 00000100:00100000:3.0:1787852921.168527:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552300288 00000100:00100000:3.0:1787852921.168612:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787852921.168635:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a29e79cd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+12:6702:x1874699552300288:12345-0@lo:502: 00000100:00100000:3.0:1787852921.168967:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a29e79cd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+12:6702:x1874699552300288:12345-0@lo:502: Request processed in 345us (3753us total) trans 0 rc 0/0 00000100:00100000:3.0:1787852921.168977:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787852921.169394:0:6702:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ac6234f1 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d48a955-7010-4118-9c7d-f396984ae1ff:6702:1874699552300288:0@lo:502: 00000020:01000000:0.0:1787852921.169447:0:6702:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787852921.169457:0:6702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787852921.169459:0:6702:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787852921.169468:0:6702:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f492abd6000 00000020:00000080:0.0:1787852921.169471:0:6702:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787852921.169531:0:6702:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49216e5680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d48a955-7010-4118-9c7d-f396984ae1ff:6702:1874699552300416:0@lo:502: 00000100:00100000:0.0:1787852921.169597:0:6702:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787852921.169639:0:6702:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f490613cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1787852921.169754:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552300416 00000100:00100000:3.0:1787852921.169761:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552300416 00000100:00100000:3.0:1787852921.169796:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787852921.169804:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4906232c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+12:6702:x1874699552300416:12345-0@lo:502: 00000100:00100000:3.0:1787852921.169989:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4906232c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+12:6702:x1874699552300416:12345-0@lo:502: Request processed in 185us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1787852921.169997:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787852921.170243:0:6702:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49216e5680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d48a955-7010-4118-9c7d-f396984ae1ff:6702:1874699552300416:0@lo:502: 00000020:01000000:0.0:1787852921.170264:0:6702:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787852921.170269:0:6702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787852921.170271:0:6702:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1787852921.170275:0:6702:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1787852921.170833:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1787852921.170858:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787852921.170868:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f49421e3200/0x710df789068e5fc3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e5fca expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852921.170889:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: ffff8f49421e3200/0x710df789068e5fc3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e5fca expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787852921.170898:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1787852921.170901:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8f490300cd70 from 1 10000000:01000000:3.0:1787852921.170904:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787852921.170930:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f49029cc400/0x710df789068e5fd1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852921.170938:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.101@tcp lock: ffff8f49029cc400/0x710df789068e5fd1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852921.170948:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: ffff8f49029cc400/0x710df789068e5fd1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787852921.170965:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4914199a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552300544:0@lo:101: 00000100:00100000:3.0:1787852921.171010:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787852921.171044:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f493c4fec00 going to sleep for 11 seconds 00000100:00100000:3.0:1787852921.171062:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552300544 00000100:00100000:3.0:1787852921.171067:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552300544 00000100:00100000:3.0:1787852921.171156:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787852921.171167:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4906233c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+12:5834:x1874699552300544:12345-0@lo:101: 00010000:00010000:3.0:1787852921.171180:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787852921.171194:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f49029cce00/0x710df789068e5fd8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x710df789068e5fd1 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852921.171221:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f49029cce00/0x710df789068e5fd8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x710df789068e5fd1 expref: 13 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852921.171255:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f49029cce00/0x710df789068e5fd8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x710df789068e5fd1 expref: 13 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852921.171266:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49029cce00, rc 0) 00000100:00100000:3.0:1787852921.171303:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4906233c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+13:5834:x1874699552300544:12345-0@lo:101: Request processed in 139us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1787852921.171309:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787852921.173172:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4914199a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552300544:0@lo:101: 00010000:00010000:3.0:1787852921.173264:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: ffff8f49029cc400/0x710df789068e5fd1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e5fd8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852921.173276:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: ffff8f49029cc400/0x710df789068e5fd1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x710df789068e5fd8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787852921.173362:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4914199a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552300672:0@lo:501: 00000100:00100000:3.0:1787852921.173425:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787852921.173464:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f493c4fec00 going to sleep for 11 seconds 00000100:00100000:0.0:1787852921.175730:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552300672 00000100:00100000:0.0:1787852921.175749:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552300672 00000100:00100000:0.0:1787852921.176013:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787852921.176024:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4906231c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d48a955-7010-4118-9c7d-f396984ae1ff+13:5834:x1874699552300672:12345-0@lo:501: 00000100:00100000:3.0:1787852921.176620:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4914199a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552300672:0@lo:501: 10000000:01000000:3.0:1787852921.176666:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.101@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787852921.176677:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f49029cc400/0x710df789068e5fd1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e5fd8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852921.176689:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: ffff8f49029cc400/0x710df789068e5fd1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e5fd8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787852921.177492:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4906231c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d48a955-7010-4118-9c7d-f396984ae1ff+13:5834:x1874699552300672:12345-0@lo:501: Request processed in 1466us (4063us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787852921.177504:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787852921.180294:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4911c02850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+12:6679:x1874699552297344:12345-0@lo:253: Request processed in 277125us (282221us total) trans 0 rc 0/0 00000100:00100000:0.0:1787852921.180328:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787852921.180500:0:6679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f491419bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d48a955-7010-4118-9c7d-f396984ae1ff:6679:1874699552297344:0@lo:253: 10000000:01000000:1.0:1787852921.180517:0:6679:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1787852921.180520:0:6679:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787852921.180522:0:6679:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787852921.180523:0:6679:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787852921.180525:0:6679:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:1.0:1787852921.180526:0:6679:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787852921.180527:0:6679:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787852921.180529:0:6679:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787852921.180531:0:6679:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1787852921.180533:0:6679:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787852921.180534:0:6679:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787852921.180556:0:6679:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8f4903010800 from lustre-OST0000 10000000:01000000:1.0:1787852921.180625:0:6679:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1787852921.180628:0:6679:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1787852921.180636:0:6679:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8f490300cd70 local copy 00010000:00010000:1.0:1787852921.180656:0:6679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f49029cc400/0x710df789068e5fd1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e5fd8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787852921.180789:0:6679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4921697840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d48a955-7010-4118-9c7d-f396984ae1ff:6679:1874699552300800:0@lo:501: 00000100:00100000:1.0:1787852921.180838:0:6679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787852921.180888:0:6679:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f4911fc2d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787852921.181137:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552300800 00000100:00100000:2.0:1787852921.181145:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552300800 00000100:00100000:2.0:1787852921.181193:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787852921.181203:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4906232050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+12:6679:x1874699552300800:12345-0@lo:501: 00000100:00100000:2.0:1787852921.181451:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4906232050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+12:6679:x1874699552300800:12345-0@lo:501: Request processed in 248us (611us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787852921.181459:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787852921.181504:0:6679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4921697840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d48a955-7010-4118-9c7d-f396984ae1ff:6679:1874699552300800:0@lo:501: 10000000:01000000:2.0:1787852921.181520:0:6679:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.101@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787852921.181546:0:6679:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.101@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787852921.181553:0:6679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f49029cc400/0x710df789068e5fd1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e5fd8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787852921.181562:0:6679:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: ffff8f49029cc400/0x710df789068e5fd1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e5fd8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787852921.181607:0:6679:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8f4903010800 10000000:01000000:2.0:1787852921.181612:0:6679:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787852921.181616:0:6679:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8f490300cd70 10000000:01000000:2.0:1787852921.181618:0:6679:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1787852921.181629:0:6679:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8f490300cd70 from 1 10000000:01000000:2.0:1787852921.181632:0:6679:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1787852921.181783:0:6679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f49013fde00/0x710df789068e5fdf lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787852921.181792:0:6679:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.101@tcp lock: ffff8f49013fde00/0x710df789068e5fdf lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787852921.181801:0:6679:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: ffff8f49013fde00/0x710df789068e5fdf lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787852921.181815:0:6679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4904cd4780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d48a955-7010-4118-9c7d-f396984ae1ff:6679:1874699552300928:0@lo:101: 00000100:00100000:2.0:1787852921.181853:0:6679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787852921.181870:0:6679:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f49062a3900 going to sleep for 11 seconds 00000100:00100000:0.0:1787852921.181955:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552300928 00000100:00100000:0.0:1787852921.181960:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552300928 00000100:00100000:0.0:1787852921.181994:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787852921.182003:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4906232850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+12:6679:x1874699552300928:12345-0@lo:101: 00010000:00010000:0.0:1787852921.182015:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787852921.182031:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f4900030a00/0x710df789068e5fe6 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x710df789068e5fdf expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852921.182055:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f4900030a00/0x710df789068e5fe6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x710df789068e5fdf expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852921.182066:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f4900030a00/0x710df789068e5fe6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x710df789068e5fdf expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852921.182075:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4900030a00, rc 0) 00000100:00100000:0.0:1787852921.182111:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4906232850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+13:6679:x1874699552300928:12345-0@lo:101: Request processed in 110us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1787852921.182118:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787852921.182156:0:6679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4904cd4780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d48a955-7010-4118-9c7d-f396984ae1ff:6679:1874699552300928:0@lo:101: 00010000:00010000:0.0:1787852921.182167:0:6679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: ffff8f49013fde00/0x710df789068e5fdf lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e5fe6 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852921.182176:0:6679:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: ffff8f49013fde00/0x710df789068e5fdf lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x710df789068e5fe6 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787852921.182192:0:6679:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.101@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1787852921.182202:0:6679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f49013fde00/0x710df789068e5fdf lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e5fe6 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852921.182217:0:6679:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: ffff8f49013fde00/0x710df789068e5fdf lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e5fe6 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787852921.182223:0:6679:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1787852921.182226:0:6679:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787852921.182231:0:6679:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1787852921.182233:0:6679:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1787852921.182259:0:6679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f4900030e00/0x710df789068e5fed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852921.182267:0:6679:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.101@tcp lock: ffff8f4900030e00/0x710df789068e5fed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852921.182274:0:6679:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: ffff8f4900030e00/0x710df789068e5fed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787852921.182286:0:6679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49216e5680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d48a955-7010-4118-9c7d-f396984ae1ff:6679:1874699552301056:0@lo:101: 00000100:00100000:0.0:1787852921.182309:0:6679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787852921.182322:0:6679:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f490613cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787852921.182333:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552301056 00000100:00100000:0.0:1787852921.182336:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552301056 00000100:00100000:0.0:1787852921.182351:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787852921.182356:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4906233450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+13:6679:x1874699552301056:12345-0@lo:101: 00010000:00010000:0.0:1787852921.182362:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787852921.182369:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f4900031a00/0x710df789068e5ff4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x710df789068e5fed expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852921.182383:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f4900031a00/0x710df789068e5ff4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x710df789068e5fed expref: 14 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852921.182398:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f4900031a00/0x710df789068e5ff4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x710df789068e5fed expref: 14 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852921.182404:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4900031a00, rc 0) 00000100:00100000:0.0:1787852921.182431:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4906233450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+14:6679:x1874699552301056:12345-0@lo:101: Request processed in 74us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1787852921.182436:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787852921.182473:0:6679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49216e5680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d48a955-7010-4118-9c7d-f396984ae1ff:6679:1874699552301056:0@lo:101: 00010000:00010000:0.0:1787852921.182484:0:6679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: ffff8f4900030e00/0x710df789068e5fed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e5ff4 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852921.182491:0:6679:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: ffff8f4900030e00/0x710df789068e5fed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x710df789068e5ff4 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787852921.182557:0:6679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49216e5680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d48a955-7010-4118-9c7d-f396984ae1ff:6679:1874699552301184:0@lo:501: 00000100:00100000:0.0:1787852921.182598:0:6679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787852921.182613:0:6679:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f490613cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787852921.182624:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552301184 00000100:00100000:0.0:1787852921.182628:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552301184 00000100:00100000:0.0:1787852921.183084:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787852921.183094:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4906232450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+14:6679:x1874699552301184:12345-0@lo:501: 00000100:00100000:0.0:1787852921.183771:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4906232450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+14:6679:x1874699552301184:12345-0@lo:501: Request processed in 678us (1169us total) trans 0 rc 0/0 00000100:00100000:0.0:1787852921.183780:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787852921.183981:0:6679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49216e5680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d48a955-7010-4118-9c7d-f396984ae1ff:6679:1874699552301184:0@lo:501: 00000100:00100000:1.0:1787852921.184030:0:6679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4921696d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d48a955-7010-4118-9c7d-f396984ae1ff:6679:1874699552301312:0@lo:503: 00000100:00100000:1.0:1787852921.184083:0:6679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787852921.184128:0:6679:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f4911fc2d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787852921.184220:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552301312 00000100:00100000:0.0:1787852921.184225:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552301312 00000100:00100000:0.0:1787852921.184350:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787852921.184358:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4906230050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d48a955-7010-4118-9c7d-f396984ae1ff+14:6679:x1874699552301312:12345-0@lo:503: 00000100:00100000:0.0:1787852921.185015:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4906230050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d48a955-7010-4118-9c7d-f396984ae1ff+14:6679:x1874699552301312:12345-0@lo:503: Request processed in 655us (929us total) trans 0 rc 0/0 00000100:00100000:0.0:1787852921.185025:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787852921.185338:0:6679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4921696d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d48a955-7010-4118-9c7d-f396984ae1ff:6679:1874699552301312:0@lo:503: 00000040:00080000:0.0:1787852921.186385:0:6679:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787852921.186835:0:6679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49216e52c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d48a955-7010-4118-9c7d-f396984ae1ff:6679:1874699552301440:0@lo:502: 00000100:00100000:0.0:1787852921.186908:0:6679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787852921.187074:0:6679:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f49063d4300 going to sleep for 11 seconds 00000100:00100000:2.0:1787852921.187170:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552301440 00000100:00100000:2.0:1787852921.187177:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552301440 00000100:00100000:2.0:1787852921.187318:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787852921.187328:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4906230c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+14:6679:x1874699552301440:12345-0@lo:502: 00000100:00100000:2.0:1787852921.187663:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4906230c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+14:6679:x1874699552301440:12345-0@lo:502: Request processed in 336us (754us total) trans 0 rc 0/0 00000100:00100000:2.0:1787852921.187671:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787852921.188036:0:6679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49216e52c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d48a955-7010-4118-9c7d-f396984ae1ff:6679:1874699552301440:0@lo:502: 00000040:00080000:1.0:1787852921.188757:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1787852921.189056:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1787852921.189364:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1787852921.189486:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1787852921.189525:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1787852921.189735:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1787852921.189783:0:6679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49216e4780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d48a955-7010-4118-9c7d-f396984ae1ff:6679:1874699552301568:0@lo:502: 00000100:00100000:0.0:1787852921.190373:0:6679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787852921.190566:0:6679:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f49063d4300 going to sleep for 11 seconds 00000100:00100000:1.0:1787852921.190886:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552301568 00000100:00100000:1.0:1787852921.190897:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552301568 00000100:00100000:1.0:1787852921.191039:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787852921.191049:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4906233050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d48a955-7010-4118-9c7d-f396984ae1ff+14:6679:x1874699552301568:12345-0@lo:502: 00000100:00100000:1.0:1787852921.191320:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4906233050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d48a955-7010-4118-9c7d-f396984ae1ff+14:6679:x1874699552301568:12345-0@lo:502: Request processed in 272us (948us total) trans 0 rc 0/0 00000100:00100000:1.0:1787852921.191329:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787852921.191445:0:6679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49216e4780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d48a955-7010-4118-9c7d-f396984ae1ff:6679:1874699552301568:0@lo:502: 00000040:00080000:2.0:1787852921.191657:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1787852921.191674:0:6679:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:2.0:1787852921.192883:0:6703:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787852921.192893:0:6703:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1787852921.192900:0:6703:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787852921.192902:0:6703:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1787852921.192909:0:6703:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787852921.192935:0:6703:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8f49065fcd70) 00000020:00000080:2.0:1787852921.192971:0:6703:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type obdfilter with refcount 2 00000020:00000080:2.0:1787852921.192979:0:6703:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787852921.193055:0:6703:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f4903010800 from lustre-OST0000, refs=2 00080000:01000000:2.0:1787852921.193063:0:6703:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787852921.193070:0:6703:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x710df789068e6002 00010000:00010000:3.0:1787852921.203125:0:6703:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:3.0:1787852921.203650:0:6703:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:3.0:1787852921.206663:0:6703:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1787852921.208720:0:6703:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:0.0:1787852921.236883:0:6703:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:0.0:1787852921.237627:0:6703:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1787852921.242641:0:6703:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1787852921.242657:0:6703:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787852921.242673:0:6703:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787852921.242676:0:6703:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1787852921.242681:0:6703:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787852921.242686:0:6703:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787852921.242688:0:6703:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787852921.242692:0:6703:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787852921.242694:0:6703:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787852921.242768:0:6703:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787852921.242773:0:6703:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787852921.242774:0:6703:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787852921.242777:0:6703:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1787852921.244661:0:6679:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:2.0:1787852921.244723:0:6679:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.101@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1787852921.244753:0:6679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f4900030e00/0x710df789068e5fed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e5ff4 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787852921.244766:0:6679:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: ffff8f4900030e00/0x710df789068e5fed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e5ff4 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787852921.244953:0:6679:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f4903010800 from 1 10000000:01000000:3.0:1787852921.244958:0:6679:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787852921.245014:0:6679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f49029cc200/0x710df789068e6009 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852921.245025:0:6679:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.101@tcp lock: ffff8f49029cc200/0x710df789068e6009 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852921.245038:0:6679:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: ffff8f49029cc200/0x710df789068e6009 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787852921.245063:0:6679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4914199a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d48a955-7010-4118-9c7d-f396984ae1ff:6679:1874699552301696:0@lo:101: 00000100:00100000:3.0:1787852921.245161:0:6679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787852921.245284:0:6679:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f493c4fe180 going to sleep for 11 seconds 00000100:00100000:2.0:1787852921.245776:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552301696 00000100:00100000:2.0:1787852921.245785:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552301696 00000100:00100000:2.0:1787852921.245964:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787852921.245978:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4906231850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+14:6679:x1874699552301696:12345-0@lo:101: 00010000:00010000:2.0:1787852921.245996:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787852921.246014:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f49013fc600/0x710df789068e6010 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x710df789068e6009 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787852921.246042:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f49013fc600/0x710df789068e6010 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x710df789068e6009 expref: 15 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787852921.246054:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f49013fc600/0x710df789068e6010 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x710df789068e6009 expref: 15 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787852921.246064:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49013fc600, rc 0) 00000100:00100000:2.0:1787852921.246138:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4906231850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+15:6679:x1874699552301696:12345-0@lo:101: Request processed in 165us (978us total) trans 0 rc 0/0 00000100:00100000:2.0:1787852921.246162:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787852921.246277:0:6679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4914199a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d48a955-7010-4118-9c7d-f396984ae1ff:6679:1874699552301696:0@lo:101: 00010000:00010000:3.0:1787852921.246293:0:6679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: ffff8f49029cc200/0x710df789068e6009 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e6010 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852921.246310:0:6679:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: ffff8f49029cc200/0x710df789068e6009 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x710df789068e6010 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787852921.246453:0:6679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4914199a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d48a955-7010-4118-9c7d-f396984ae1ff:6679:1874699552301824:0@lo:501: 00000100:00100000:3.0:1787852921.246493:0:6679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787852921.246522:0:6679:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f493c4fe180 going to sleep for 11 seconds 00000100:00100000:3.0:1787852921.246539:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552301824 00000100:00100000:3.0:1787852921.246545:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552301824 00000100:00100000:3.0:1787852921.246596:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787852921.246604:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4906230450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+15:6679:x1874699552301824:12345-0@lo:501: 00000100:00100000:3.0:1787852921.247228:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4906230450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+15:6679:x1874699552301824:12345-0@lo:501: Request processed in 623us (732us total) trans 0 rc 0/0 00000100:00100000:3.0:1787852921.247238:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787852921.247295:0:6679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4914199a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d48a955-7010-4118-9c7d-f396984ae1ff:6679:1874699552301824:0@lo:501: 00000100:00100000:3.0:1787852921.247334:0:6679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4914199a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d48a955-7010-4118-9c7d-f396984ae1ff:6679:1874699552301952:0@lo:503: 00000100:00100000:3.0:1787852921.249975:0:6679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787852921.250070:0:6679:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f493c4fe180 going to sleep for 11 seconds 00000100:00100000:2.0:1787852921.250164:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552301952 00000100:00100000:2.0:1787852921.250174:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552301952 00000100:00100000:2.0:1787852921.250273:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787852921.250284:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4906233850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+15:6679:x1874699552301952:12345-0@lo:503: 00000100:00100000:2.0:1787852921.250530:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4906233850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+15:6679:x1874699552301952:12345-0@lo:503: Request processed in 248us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1787852921.250539:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787852921.250763:0:6679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4914199a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d48a955-7010-4118-9c7d-f396984ae1ff:6679:1874699552301952:0@lo:503: 00000040:00080000:3.0:1787852921.251154:0:6679:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787852921.251226:0:6679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4914199a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d48a955-7010-4118-9c7d-f396984ae1ff:6679:1874699552302080:0@lo:502: 00000100:00100000:3.0:1787852921.251274:0:6679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787852921.251307:0:6679:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f493c4fe180 going to sleep for 11 seconds 00000100:00100000:3.0:1787852921.251326:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552302080 00000100:00100000:3.0:1787852921.251333:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552302080 00000100:00100000:3.0:1787852921.251369:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787852921.251384:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f490621c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+15:6679:x1874699552302080:12345-0@lo:502: 00000100:00100000:3.0:1787852921.251647:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f490621c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+15:6679:x1874699552302080:12345-0@lo:502: Request processed in 263us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1787852921.251736:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787852921.251783:0:6679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4914199a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d48a955-7010-4118-9c7d-f396984ae1ff:6679:1874699552302080:0@lo:502: 00000040:00080000:3.0:1787852921.252377:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1787852921.252426:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1787852921.252455:0:6679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4914199a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d48a955-7010-4118-9c7d-f396984ae1ff:6679:1874699552302208:0@lo:502: 00000100:00100000:3.0:1787852921.253171:0:6679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787852921.253247:0:6679:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f493c4fe180 going to sleep for 11 seconds 00000100:00100000:2.0:1787852921.253285:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552302208 00000100:00100000:2.0:1787852921.253292:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552302208 00000100:00100000:2.0:1787852921.253361:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787852921.253370:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f490621c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+15:6679:x1874699552302208:12345-0@lo:502: 00000100:00100000:3.0:1787852921.254063:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f490621c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+15:6679:x1874699552302208:12345-0@lo:502: Request processed in 692us (890us total) trans 0 rc 0/0 00000100:00100000:3.0:1787852921.254071:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787852921.254263:0:6679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4914199a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d48a955-7010-4118-9c7d-f396984ae1ff:6679:1874699552302208:0@lo:502: 00000040:00080000:2.0:1787852921.254404:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1787852921.254418:0:6679:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1787852921.255324:0:6707:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787852921.255335:0:6707:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787852921.255338:0:6707:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787852921.255347:0:6707:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f4903010800 00000020:00000080:2.0:1787852921.255350:0:6707:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787852921.255371:0:6707:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787852921.255375:0:6707:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787852921.255376:0:6707:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1787852921.255379:0:6707:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1787852921.255562:0:6679:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1787852921.255608:0:6679:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787852921.255631:0:6679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f49029cc200/0x710df789068e6009 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e6010 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852921.255644:0:6679:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: ffff8f49029cc200/0x710df789068e6009 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e6010 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787852921.255688:0:6679:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787852921.255691:0:6679:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8f4903010800 10000000:01000000:3.0:1787852921.255694:0:6679:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8f4903010800 10000000:01000000:3.0:1787852921.255698:0:6679:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787852921.255705:0:6679:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8f4903010800 from 1 10000000:01000000:3.0:1787852921.255707:0:6679:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787852921.255740:0:6679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f49029cd200/0x710df789068e6017 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852921.255755:0:6679:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.101@tcp lock: ffff8f49029cd200/0x710df789068e6017 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852921.255766:0:6679:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: ffff8f49029cd200/0x710df789068e6017 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787852921.255786:0:6679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f491419b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d48a955-7010-4118-9c7d-f396984ae1ff:6679:1874699552302336:0@lo:101: 00000100:00100000:3.0:1787852921.255847:0:6679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787852921.255884:0:6679:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f493c4feb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787852921.255904:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552302336 00000100:00100000:3.0:1787852921.255910:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552302336 00000100:00100000:3.0:1787852921.255946:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787852921.255954:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f490621e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d48a955-7010-4118-9c7d-f396984ae1ff+15:6679:x1874699552302336:12345-0@lo:101: 00010000:00010000:3.0:1787852921.255968:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787852921.255980:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f49029cc000/0x710df789068e601e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x710df789068e6017 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852921.256003:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f49029cc000/0x710df789068e601e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x710df789068e6017 expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852921.256016:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f49029cc000/0x710df789068e601e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x710df789068e6017 expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852921.256026:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49029cc000, rc 0) 00000100:00100000:3.0:1787852921.256060:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f490621e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d48a955-7010-4118-9c7d-f396984ae1ff+16:6679:x1874699552302336:12345-0@lo:101: Request processed in 106us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1787852921.256066:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787852921.256112:0:6679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f491419b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d48a955-7010-4118-9c7d-f396984ae1ff:6679:1874699552302336:0@lo:101: 00010000:00010000:3.0:1787852921.256132:0:6679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: ffff8f49029cd200/0x710df789068e6017 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e601e expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852921.256140:0:6679:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: ffff8f49029cd200/0x710df789068e6017 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x710df789068e601e expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787852921.256233:0:6679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f491419b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d48a955-7010-4118-9c7d-f396984ae1ff:6679:1874699552302464:0@lo:501: 00000100:00100000:3.0:1787852921.256256:0:6679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787852921.256271:0:6679:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f493c4feb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787852921.256284:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552302464 00000100:00100000:3.0:1787852921.256288:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552302464 00000100:00100000:3.0:1787852921.256310:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787852921.256316:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f490621f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+16:6679:x1874699552302464:12345-0@lo:501: 00000100:00100000:3.0:1787852921.258184:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f490621f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+16:6679:x1874699552302464:12345-0@lo:501: Request processed in 1860us (1917us total) trans 0 rc 0/0 00000100:00100000:3.0:1787852921.258196:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787852921.258400:0:6679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f491419b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d48a955-7010-4118-9c7d-f396984ae1ff:6679:1874699552302464:0@lo:501: 00000100:00100000:2.0:1787852921.258453:0:6679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4904cd4780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d48a955-7010-4118-9c7d-f396984ae1ff:6679:1874699552302592:0@lo:503: 00000100:00100000:2.0:1787852921.258499:0:6679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787852921.258567:0:6679:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f49101b80c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787852921.258655:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552302592 00000100:00100000:3.0:1787852921.258663:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552302592 00000100:00100000:3.0:1787852921.258721:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787852921.258731:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f490621f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+16:6679:x1874699552302592:12345-0@lo:503: 00000100:00100000:3.0:1787852921.258925:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f490621f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+16:6679:x1874699552302592:12345-0@lo:503: Request processed in 196us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1787852921.258932:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787852921.258972:0:6679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4904cd4780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d48a955-7010-4118-9c7d-f396984ae1ff:6679:1874699552302592:0@lo:503: 00000040:00080000:3.0:1787852921.259258:0:6679:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787852921.259345:0:6679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f491419a580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d48a955-7010-4118-9c7d-f396984ae1ff:6679:1874699552302720:0@lo:502: 00000100:00100000:3.0:1787852921.259379:0:6679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787852921.259420:0:6679:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f493c4fecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787852921.259512:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552302720 00000100:00100000:2.0:1787852921.259517:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552302720 00000100:00100000:2.0:1787852921.259546:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787852921.259552:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f490621d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+16:6679:x1874699552302720:12345-0@lo:502: 00000100:00100000:2.0:1787852921.259766:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f490621d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+16:6679:x1874699552302720:12345-0@lo:502: Request processed in 213us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1787852921.259774:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787852921.261161:0:6679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f491419a580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d48a955-7010-4118-9c7d-f396984ae1ff:6679:1874699552302720:0@lo:502: 00000040:00080000:3.0:1787852921.263915:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1787852921.264015:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1787852921.264050:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1787852921.264098:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1787852921.264137:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1787852921.264207:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1787852921.264243:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1787852921.264275:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1787852921.264322:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1787852921.264366:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1787852921.264399:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1787852921.264459:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1787852921.264514:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1787852921.264546:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1787852921.264627:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1787852921.264665:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1787852921.264695:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1787852921.264741:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1787852921.264776:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1787852921.264833:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1787852921.264883:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1787852921.264935:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1787852921.264988:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1787852921.265041:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1787852921.265078:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1787852921.265124:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1787852921.265183:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1787852921.265239:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:3.0:1787852921.266197:0:6679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f491419a580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d48a955-7010-4118-9c7d-f396984ae1ff:6679:1874699552302848:0@lo:502: 00000100:00100000:3.0:1787852921.266284:0:6679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787852921.266348:0:6679:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f493c4fecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787852921.266681:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552302848 00000100:00100000:2.0:1787852921.266688:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552302848 00000100:00100000:2.0:1787852921.266919:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787852921.266929:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f490621fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+16:6679:x1874699552302848:12345-0@lo:502: 00000100:00100000:3.0:1787852921.268257:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f490621fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+16:6679:x1874699552302848:12345-0@lo:502: Request processed in 1323us (1968us total) trans 0 rc 0/0 00000100:00100000:3.0:1787852921.268267:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787852921.268355:0:6679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f491419a580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d48a955-7010-4118-9c7d-f396984ae1ff:6679:1874699552302848:0@lo:502: 00000040:00080000:0.0:1787852921.268469:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1787852921.268497:0:6679:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:0.0:1787852921.270412:0:6708:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1787852921.270433:0:6708:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8f493484b3a0) 00000020:00000080:0.0:1787852921.270471:0:6708:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lwp with refcount 2 00000020:01000004:0.0:1787852921.270554:0:6708:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f4903010800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787852921.270558:0:6708:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f4903010800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787852921.270560:0:6708:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f4903010800 3 00010000:00080000:0.0:1787852921.270613:0:6708:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f480186c000@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.101@tcp at head 00010000:00010000:0.0:1787852921.272373:0:6708:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-3 is initialized 00000020:00000080:0.0:1787852921.274493:0:6708:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1787852921.276645:0:6708:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787852921.276664:0:6708:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x710df789068e602c 00000100:00080000:1.0:1787852921.276676:0:6708:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787852921.276683:0:6708:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8f480186c000 using connection 192.168.204.101@tcp/0@lo 00000100:00100000:1.0:1787852921.276722:0:6708:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f4921696d00 x1874699552302976/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787852921.276748:0:6708:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787852921.276955:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4921696d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1874699552302976:0@lo:38: 00000100:00100000:0.0:1787852921.277034:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787852921.277158:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552302976 00000100:00100000:1.0:1787852921.277165:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552302976 00000100:00100000:1.0:1787852921.277203:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787852921.277210:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49216e7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3305:x1874699552302976:12345-0@lo:38: 00010000:00080000:1.0:1787852921.277235:0:5836:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 240 last 0 00000020:00000080:1.0:1787852921.277266:0:5836:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x710df789068e6033 00000004:00100000:1.0:1787852921.277281:0:5836:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787852921.277312:0:5836:0:(import.c:65:import_set_state_nolock()) ffff8f48011b5800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787852921.277365:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49216e7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874699552302976:12345-0@lo:38: Request processed in 154us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1787852921.277372:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787852921.277458:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8f4921696d00 x1874699552302976/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787852931 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787852921.277469:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787852921.277477:0:3305:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1787852921.277484:0:3305:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787852921.277489:0:3305:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787852921.277491:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8f480186c000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787852921.277497:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4921696d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1874699552302976:0@lo:38: 00000040:00080000:1.0:1787852921.280422:0:6708:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:3.0:1787852921.280615:0:6679:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:3.0:1787852921.280641:0:6679:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787852921.280659:0:6679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f49029cd200/0x710df789068e6017 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e601e expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852921.280673:0:6679:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: ffff8f49029cd200/0x710df789068e6017 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e601e expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787852921.280715:0:6679:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787852921.280717:0:6679:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787852921.280718:0:6679:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787852921.280719:0:6679:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787852921.280720:0:6679:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787852921.280722:0:6679:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787852921.280724:0:6679:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787852921.280725:0:6679:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787852921.280727:0:6679:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787852921.280728:0:6679:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787852921.280730:0:6679:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787852921.280733:0:6679:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:3.0:1787852921.280735:0:6679:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787852921.280737:0:6679:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787852921.280738:0:6679:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787852921.280739:0:6679:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787852921.280740:0:6679:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787852921.280741:0:6679:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787852921.280742:0:6679:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787852921.280743:0:6679:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787852921.280744:0:6679:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787852921.280745:0:6679:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787852921.280745:0:6679:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787852921.280771:0:6679:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1787852921.280794:0:6679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f491419a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d48a955-7010-4118-9c7d-f396984ae1ff:6679:1874699552303104:0@lo:253: 00000100:00100000:3.0:1787852921.280872:0:6679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787852921.280912:0:6679:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f493c4fe9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787852921.280978:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552303104 00000100:00100000:1.0:1787852921.280985:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552303104 00000100:00100000:1.0:1787852921.281035:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787852921.281045:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f490621d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+16:6679:x1874699552303104:12345-0@lo:253: 20000000:01000000:1.0:1787852921.281074:0:5830:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1787852921.281089:0:5830:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1787852921.310612:0:5830:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787852921.310638:0:5830:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1787852921.310694:0:5852:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787852921.310700:0:5852:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787852921.310721:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f4900031600/0x710df789068e603a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852921.310739:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f4900030c00/0x710df789068e5f61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x710df789068e5f5a expref: 16 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852921.310748:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f4900031600/0x710df789068e603a lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852921.310790:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f4900030c00/0x710df789068e5f61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x710df789068e5f5a expref: 16 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852921.310805:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f4900030c00/0x710df789068e5f61 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x710df789068e5f5a expref: 16 pid: 5829 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787852921.310849:0:5852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49216e70c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5852:1874699552303232:0@lo:104: 00000100:00100000:0.0:1787852921.310918:0:5852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787852921.310980:0:5852:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f48013caa80 going to sleep for 11 seconds 00000100:00100000:3.0:1787852921.311417:0:5820:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787852921.311442:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552303232 00000100:00100000:3.0:1787852921.311450:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552303232 00000100:00100000:3.0:1787852921.311528:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787852921.311539:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4911c06450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5d48a955-7010-4118-9c7d-f396984ae1ff+3:5852:x1874699552303232:12345-0@lo:104: 00010000:00010000:3.0:1787852921.311555:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.101@tcp lock: ffff8f49013fd200/0x710df789068e5f5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x710df789068e5f61 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852921.311642:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787852921.311649:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4911c06450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5d48a955-7010-4118-9c7d-f396984ae1ff+3:5852:x1874699552303232:12345-0@lo:104: Request processed in 112us (732us total) trans 0 rc 0/0 00000100:00100000:3.0:1787852921.311656:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1787852921.311708:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787852921.311715:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.101@tcp lock: ffff8f49013fd200/0x710df789068e5f5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x710df789068e5f61 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852921.311722:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49013fd200 already unused, calling callback (ffffffffc1b55c20) 10000000:00010000:3.0:1787852921.311726:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.101@tcp lock: ffff8f49013fd200/0x710df789068e5f5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x710df789068e5f61 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852921.311734:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.101@tcp lock: ffff8f49013fd200/0x710df789068e5f5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x710df789068e5f61 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787852921.311740:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.101@tcp lock: ffff8f49013fd200/0x710df789068e5f5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x710df789068e5f61 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787852921.311760:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787852921.311793:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.101@tcp lock: ffff8f49013fd200/0x710df789068e5f5a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x710df789068e5f61 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852921.311800:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787852921.311830:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.101@tcp lock: ffff8f49013fd200/0x710df789068e5f5a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x710df789068e5f61 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852921.311838:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.101@tcp lock: ffff8f49013fd200/0x710df789068e5f5a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x710df789068e5f61 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852921.311858:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787852921.311860:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787852921.311861:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787852921.311917:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787852921.311929:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4914199680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5d48a955-7010-4118-9c7d-f396984ae1ff:3307:1874699552303360:0@lo:103: 00000100:00100000:0.0:1787852921.311967:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787852921.312028:0:5852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49216e70c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5852:1874699552303232:0@lo:104: 00010000:00010000:0.0:1787852921.312048:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f4900031600/0x710df789068e603a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787852921.313016:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552303360 00000100:00100000:3.0:1787852921.313025:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552303360 00010000:00010000:3.0:1787852921.313055:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f4900030c00/0x710df789068e5f61 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x710df789068e5f5a expref: 17 pid: 5829 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787852921.313094:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787852921.313101:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49216e43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d48a955-7010-4118-9c7d-f396984ae1ff+17:3307:x1874699552303360:12345-0@lo:103: 00010000:00010000:3.0:1787852921.313115:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787852921.313120:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f4900030c00/0x710df789068e5f61 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x710df789068e5f5a expref: 17 pid: 5829 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852921.313131:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f4900030c00/0x710df789068e5f61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x710df789068e5f5a expref: 17 pid: 5829 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852921.313147:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f4900030c00/0x710df789068e5f61 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x710df789068e5f5a expref: 17 pid: 5829 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852921.313180:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f4900031600/0x710df789068e603a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852921.313188:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f4900031600/0x710df789068e603a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787852921.313204:0:5822:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002505236s 00010000:00010000:3.0:1787852921.313209:0:5822:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f4900031600/0x710df789068e603a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852921.313217:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f4900031600/0x710df789068e603a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852921.313223:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f4900031600/0x710df789068e603a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852921.313229:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f4900031600/0x710df789068e603a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852921.313234:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4900031600 already unused, calling callback (ffffffffc1528440) 00010000:00010000:3.0:1787852921.313238:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f4900031600/0x710df789068e603a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852921.313246:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f4900031600/0x710df789068e603a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852921.313269:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f4900031600/0x710df789068e603a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852921.313280:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787852921.313338:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49216e43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d48a955-7010-4118-9c7d-f396984ae1ff+16:3307:x1874699552303360:12345-0@lo:103: Request processed in 237us (1370us total) trans 0 rc 0/0 00000100:00100000:3.0:1787852921.313344:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787852921.313423:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4914199680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5d48a955-7010-4118-9c7d-f396984ae1ff:3307:1874699552303360:0@lo:103: 00010000:00010000:1.0:1787852921.313691:0:5852:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f4900031600/0x710df789068e603a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852921.313701:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f4900031600/0x710df789068e603a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852921.313707:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f4900031600/0x710df789068e603a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787852921.324363:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f490621d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+15:6679:x1874699552303104:12345-0@lo:253: Request processed in 43309us (43480us total) trans 0 rc 0/0 00000100:00100000:2.0:1787852921.324380:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787852921.324636:0:6679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f491419a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d48a955-7010-4118-9c7d-f396984ae1ff:6679:1874699552303104:0@lo:253: 10000000:01000000:0.0:1787852921.324655:0:6679:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1787852921.324659:0:6679:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787852921.324787:0:6679:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787852921.324790:0:6679:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787852921.324791:0:6679:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787852921.324793:0:6679:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787852921.324795:0:6679:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787852921.324797:0:6679:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787852921.324799:0:6679:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787852921.324800:0:6679:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787852921.324803:0:6679:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787852921.324804:0:6679:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787852921.324832:0:6679:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1787852921.331780:0:6679:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1787852921.332006:0:6679:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1787852921.332203:0:6679:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1787852921.332405:0:6679:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1787852921.333081:0:6679:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1787852921.333344:0:6679:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1787852921.334809:0:6679:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1787852921.615850:0:6679:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1787852921.615859:0:6679:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1787852921.615894:0:6679:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787852921.615969:0:6679:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.101@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787852921.615989:0:6679:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1787852921.616028:0:6679:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1787852921.653002:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787852922.666462:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787852923.719679:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787852924.718382:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787852925.737808:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787852926.698120:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4904cd5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5d48a955-7010-4118-9c7d-f396984ae1ff:3307:1874699552303488:0@lo:400: 00000100:00100000:3.0:1787852926.698188:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787852926.698261:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552303488 00000100:00100000:0.0:1787852926.698271:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552303488 00000100:00100000:3.0:1787852926.698273:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4904cd4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874699552303616:0@lo:400: 00000100:00100000:3.0:1787852926.698305:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787852926.698345:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787852926.698355:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f490621e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+15:3307:x1874699552303488:12345-0@lo:400: 00000100:00080000:2.0:1787852926.698361:0:475:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787852926.698367:0:475:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1787852926.698371:0:475:0:(import.c:65:import_set_state_nolock()) ffff8f4906312000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787852926.698377:0:475:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 240 00000100:00080000:2.0:1787852926.698382:0:475:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787852926.698387:0:475:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8f4906312000 using connection 192.168.204.101@tcp/0@lo 00000100:00100000:2.0:1787852926.698411:0:475:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f4904cd43c0 x1874699552303744/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787852926.698416:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f490621e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+15:3307:x1874699552303488:12345-0@lo:400: Request processed in 61us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1787852926.698459:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4904cd6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1874699552303872:0@lo:400: 00000100:00100000:2.0:1787852926.698491:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787852926.698523:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4904cd43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1874699552303744:0@lo:8: 00000100:00100000:2.0:1787852926.698559:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787852926.698613:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552303616 00000100:00100000:2.0:1787852926.698617:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552303616 00000100:00100000:2.0:1787852926.698643:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552303872 00000100:00100000:2.0:1787852926.698646:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552303872 00000100:00100000:2.0:1787852926.698667:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787852926.698672:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4914198780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874699552303616:12345-0@lo:400: 00000100:00100000:2.0:1787852926.698701:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4914198780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874699552303616:12345-0@lo:400: Request processed in 28us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1787852926.698707:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787852926.698733:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787852926.698738:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4904cd61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874699552303872:12345-0@lo:400: 00000100:00100000:2.0:1787852926.698766:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4904cd61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874699552303872:12345-0@lo:400: Request processed in 28us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1787852926.698785:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787852926.698913:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552303744 00000100:00100000:1.0:1787852926.698918:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552303744 00000100:00100000:1.0:1787852926.698938:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787852926.698945:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4904cd6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3305:x1874699552303744:12345-0@lo:8: 00010000:00080000:2.0:1787852926.698965:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f4904cd6940 x1874699552303872/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787852942 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1787852926.698972:0:6684:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 246 last 0 00000100:00100000:2.0:1787852926.698987:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4904cd6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1874699552303872:0@lo:400: 00000020:00000080:1.0:1787852926.699005:0:6684:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x710df789068e6041 00010000:00080000:2.0:1787852926.699016:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f4904cd4b40 x1874699552303616/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787852942 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00002000:00100000:1.0:1787852926.699045:0:6684:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8f48011b6800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113954 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1787852926.699051:0:6684:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:1.0:1787852926.699055:0:6684:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:2.0:1787852926.699117:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4904cd4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874699552303616:0@lo:400: 00002000:00100000:1.0:1787852926.699175:0:6684:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1787852926.699417:0:6684:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787852926.699508:0:6684:0:(import.c:65:import_set_state_nolock()) ffff8f48011b4000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787852926.699585:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4904cd6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3305:x1874699552303744:12345-0@lo:8: Request processed in 624us (1009us total) trans 0 rc 0/0 00000100:00100000:1.0:1787852926.699595:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1787852926.699657:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787852926.701582:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787852926.701991:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4904cd5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5d48a955-7010-4118-9c7d-f396984ae1ff:3307:1874699552303488:0@lo:400: 00010000:00080000:2.0:1787852926.702077:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f4904cd43c0 x1874699552303744/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787852941 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787852926.702089:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787852926.702097:0:3305:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1787852926.702105:0:3305:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787852926.702111:0:3305:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1787852926.702115:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8f4906312000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787852926.703641:0:3305:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787852926.703656:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4904cd43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1874699552303744:0@lo:8: 00000004:00080000:1.0:1787852926.705047:0:6700:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787852926.708302:0:6700:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 246249728383ns, next at 0ns, rc = 0 00000001:00100000:0.0:1787852926.745193:0:6712:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1787852926.761918:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787852926.778259:0:5858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:0.0:1787852926.833403:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000004:00080000:2.0:1787852926.833737:0:6701:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:2.0:1787852926.833770:0:6701:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4904cd4b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6701:1874699552304128:0@lo:7: 00000100:00100000:2.0:1787852926.833838:0:6701:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787852926.833900:0:6701:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f490316b480 going to sleep for 11 seconds 00000100:00100000:3.0:1787852926.833953:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552304128 00000100:00100000:3.0:1787852926.833960:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552304128 00000100:00100000:3.0:1787852926.834027:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787852926.834036:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4904cd6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:6701:x1874699552304128:12345-0@lo:7: 00000100:00080000:2.0:1787852926.835816:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787852926.838446:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4904cd43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874699552304000:0@lo:13: 00000100:00100000:0.0:1787852926.838534:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787852926.838841:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552304000 00000100:00100000:1.0:1787852926.838850:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552304000 00000100:00100000:1.0:1787852926.838895:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787852926.838904:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49216e52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1874699552304000:12345-0@lo:13: 00002000:00000024:1.0:1787852926.838935:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1787852926.839398:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49216e52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1874699552304000:12345-0@lo:13: Request processed in 83us (451us total) trans 0 rc 0/0 00010000:00080000:0.0:1787852926.842222:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f4904cd43c0 x1874699552304000/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787852942 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787852926.842251:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4904cd43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874699552304000:0@lo:13: 00000100:00100000:1.0:1787852926.846481:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00002000:00080000:2.0:1787852926.863868:0:6682:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1787852926.863879:0:6682:0:(ofd_dev.c:1211:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:2.0:1787852926.863995:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4904cd6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:6701:x1874699552304128:12345-0@lo:7: Request processed in 29953us (30148us total) trans 0 rc 0/0 00000100:00100000:2.0:1787852926.864010:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787852926.864033:0:6701:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f4904cd4b40 x1874699552304128/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787852942 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787852926.864050:0:6701:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4904cd4b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6701:1874699552304128:0@lo:7: 00000004:00080000:0.0:1787852926.864067:0:6701:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:0.0:1787852926.864105:0:6701:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49216e5680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6701:1874699552304256:0@lo:5: 00000100:00100000:0.0:1787852926.864155:0:6701:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787852926.864382:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552304256 00000100:00100000:1.0:1787852926.864390:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552304256 00000100:00100000:1.0:1787852926.864441:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787852926.864451:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49216e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:6701:x1874699552304256:12345-0@lo:5: 00002000:00080000:1.0:1787852926.864478:0:6681:0:(ofd_dev.c:1643:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1787852926.864484:0:6681:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1787852926.864601:0:6701:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f493c4fecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787852926.864935:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49216e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:6701:x1874699552304256:12345-0@lo:5: Request processed in 485us (778us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1787852926.864943:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787852926.867250:0:6701:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f49216e5680 x1874699552304256/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787852942 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787852926.867274:0:6701:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49216e5680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6701:1874699552304256:0@lo:5: 00000004:00080000:2.0:1787852926.867291:0:6701:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:2.0:1787852926.867349:0:6701:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4904cd7c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6701:1874699552304384:0@lo:700: 00000100:00100000:2.0:1787852926.867406:0:6701:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787852926.867481:0:6701:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f490316bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787852926.867624:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552304384 00000100:00100000:3.0:1787852926.867631:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552304384 00000100:00100000:3.0:1787852926.867693:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787852926.867703:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4904cd4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+6:6701:x1874699552304384:12345-0@lo:700: 00000100:00100000:3.0:1787852926.867750:0:6690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4914199e00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6690:1874699552304512:0@lo:700: 00000100:00100000:3.0:1787852926.867784:0:6690:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787852926.867802:0:6690:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f493c154900 going to sleep for 11 seconds 00000100:00100000:1.0:1787852926.868143:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552304512 00000100:00100000:1.0:1787852926.868149:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552304512 00000100:00100000:1.0:1787852926.868194:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787852926.868201:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f491419b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6690:x1874699552304512:12345-0@lo:700: 40000000:02000000:0.0:1787852926.940687:0:5843:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:0.0:1787852926.954094:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f491419b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6690:x1874699552304512:12345-0@lo:700: Request processed in 85883us (86299us total) trans 0 rc 0/0 00000100:00100000:0.0:1787852926.954116:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787852926.957059:0:6690:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f4914199e00 x1874699552304512/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787852942 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787852926.957085:0:6690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4914199e00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6690:1874699552304512:0@lo:700: 40000000:02000000:1.0:1787852926.957103:0:6690:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000100:00100000:1.0:1787852927.040042:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4904cd4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+6:6701:x1874699552304384:12345-0@lo:700: Request processed in 172329us (172624us total) trans 0 rc 0/0 00000100:00100000:1.0:1787852927.040062:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787852927.040148:0:6701:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f4904cd7c00 x1874699552304384/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787852942 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787852927.040164:0:6701:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4904cd7c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6701:1874699552304384:0@lo:700: 00000001:00080000:0.0:1787852927.041551:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000004:02000040:0.0:1787852927.067525:0:6701:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:1.0:1787852927.083801:0:6701:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49216970c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6701:1874699552304640:0@lo:5: 00000100:00100000:1.0:1787852927.083879:0:6701:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787852927.083937:0:6701:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f49064fab40 going to sleep for 11 seconds 00000100:00100000:0.0:1787852927.085758:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552304640 00000100:00100000:0.0:1787852927.085770:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552304640 00000100:00100000:0.0:1787852927.085816:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787852927.085825:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4921694000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:6701:x1874699552304640:12345-0@lo:5: 00002000:00080000:2.0:1787852927.104073:0:6682:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1787852927.104095:0:6682:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:0.0:1787852927.108804:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4921694000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6701:x1874699552304640:12345-0@lo:5: Request processed in 22972us (24916us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1787852927.108818:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1787852927.109013:0:6701:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f49216970c0 x1874699552304640/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787852943 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787852927.109029:0:6701:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1787852927.109043:0:6701:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8f49216970c0 x1874699552304640/t4294967298(4294967298) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787852943 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787852927.109054:0:6701:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49216970c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6701:1874699552304640:0@lo:5: 00000004:00080000:2.0:1787852927.109068:0:6701:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 10000000:01000000:0.0:1787852927.210867:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787852927.210876:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8f492abd6000 from 4 10000000:01000000:0.0:1787852927.210881:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787852927.210928:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f4900030c00/0x710df789068e6048 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852927.210940:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.101@tcp lock: ffff8f4900030c00/0x710df789068e6048 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852927.210951:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: ffff8f4900030c00/0x710df789068e6048 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787852927.210975:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49216e7c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552304768:0@lo:101: 00000100:00100000:0.0:1787852927.211039:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787852927.211103:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f4904fda600 going to sleep for 11 seconds 00000100:00100000:1.0:1787852927.211811:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552304768 00000100:00100000:1.0:1787852927.211820:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552304768 00000100:00100000:1.0:1787852927.211877:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787852927.211887:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f490621ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+15:5834:x1874699552304768:12345-0@lo:101: 00010000:00010000:1.0:1787852927.211899:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787852927.211913:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f49421e3a00/0x710df789068e604f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x710df789068e6048 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852927.211935:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f49421e3a00/0x710df789068e604f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x710df789068e6048 expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852927.211946:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f49421e3a00/0x710df789068e604f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x710df789068e6048 expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852927.211956:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49421e3a00, rc 0) 00000100:00100000:1.0:1787852927.211998:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f490621ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+16:5834:x1874699552304768:12345-0@lo:101: Request processed in 113us (959us total) trans 0 rc 0/0 00000100:00100000:1.0:1787852927.212005:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787852927.212063:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49216e7c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552304768:0@lo:101: 00010000:00010000:1.0:1787852927.212085:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: ffff8f4900030c00/0x710df789068e6048 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e604f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852927.212094:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: ffff8f4900030c00/0x710df789068e6048 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x710df789068e604f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787852927.212142:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4921695a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552304896:0@lo:256: 00000100:00100000:1.0:1787852927.212178:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787852927.212193:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f49064fa840 going to sleep for 11 seconds 00000100:00100000:1.0:1787852927.212204:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552304896 00000100:00100000:1.0:1787852927.212207:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552304896 00000100:00100000:1.0:1787852927.212226:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787852927.212232:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4904f57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+16:5834:x1874699552304896:12345-0@lo:256: 20000000:01000000:1.0:1787852927.212247:0:5829:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787852927.212261:0:5829:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787852927.212264:0:5829:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1787852927.212345:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4904f57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+16:5834:x1874699552304896:12345-0@lo:256: Request processed in 112us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1787852927.212352:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787852927.212379:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4921695a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552304896:0@lo:256: 10000000:01000000:1.0:1787852927.212454:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787852927.212461:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f4900030c00/0x710df789068e6048 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e604f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852927.212470:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: ffff8f4900030c00/0x710df789068e6048 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e604f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852927.787393:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787852928.809913:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787852929.842934:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787852930.750184:0:7053:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg401-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787852930.857768:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787852931.824636:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49216e4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874699552305152:0@lo:400: 00000100:00100000:0.0:1787852931.824720:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787852931.824793:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787852931.824800:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49216e7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874699552305280:0@lo:400: 00000100:00100000:0.0:1787852931.824842:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787852931.824893:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552305152 00000100:00100000:0.0:1787852931.824901:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552305152 00000100:00100000:0.0:1787852931.824962:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787852931.824973:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49216e70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874699552305152:12345-0@lo:400: 00000100:00100000:0.0:1787852931.825031:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49216e70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874699552305152:12345-0@lo:400: Request processed in 60us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1787852931.825039:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1787852931.825083:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f49216e4780 x1874699552305152/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787852947 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787852931.825100:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49216e4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874699552305152:0@lo:400: 00000100:00100000:0.0:1787852931.825147:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552305280 00000100:00100000:0.0:1787852931.825151:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552305280 00000100:00100000:0.0:1787852931.825191:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787852931.825198:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49216e4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3308:x1874699552305280:12345-0@lo:400: 00000100:00100000:0.0:1787852931.825234:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49216e4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3308:x1874699552305280:12345-0@lo:400: Request processed in 36us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1787852931.825239:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787852931.825375:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49216e6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5d48a955-7010-4118-9c7d-f396984ae1ff:3307:1874699552305024:0@lo:400: 00000100:00100000:3.0:1787852931.825416:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787852931.825448:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787852931.825455:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49216e5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1874699552305408:0@lo:400: 00000100:00100000:3.0:1787852931.825477:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787852931.825507:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552305024 00000100:00100000:3.0:1787852931.825519:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552305024 00000100:00100000:3.0:1787852931.825549:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787852931.825555:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4904f54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+16:3307:x1874699552305024:12345-0@lo:400: 00000100:00100000:3.0:1787852931.825625:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4904f54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+16:3307:x1874699552305024:12345-0@lo:400: Request processed in 58us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1787852931.825632:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787852931.825663:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552305408 00000100:00100000:3.0:1787852931.825667:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552305408 00000100:00100000:3.0:1787852931.825692:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787852931.825698:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f491419a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874699552305408:12345-0@lo:400: 00000100:00100000:3.0:1787852931.825729:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f491419a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874699552305408:12345-0@lo:400: Request processed in 32us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1787852931.825735:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1787852931.825761:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f49216e5680 x1874699552305408/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787852947 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787852931.825772:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49216e5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1874699552305408:0@lo:400: 00000100:00100000:3.0:1787852931.825780:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49216e6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5d48a955-7010-4118-9c7d-f396984ae1ff:3307:1874699552305024:0@lo:400: 00000100:00080000:0.0:1787852931.826636:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787852931.826650:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787852931.827559:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f49216e7c00 x1874699552305280/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787852947 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787852931.827603:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49216e7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874699552305280:0@lo:400: 00010000:00010000:2.0:1787852931.892955:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787852932.336547:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f491419b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874699552305536:0@lo:13: 00000100:00100000:3.0:1787852932.336910:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787852932.337147:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552305536 00000100:00100000:2.0:1787852932.337156:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552305536 00000100:00100000:2.0:1787852932.337207:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787852932.337216:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4914199a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1874699552305536:12345-0@lo:13: 00002000:00000024:2.0:1787852932.337250:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787852932.337316:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4914199a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1874699552305536:12345-0@lo:13: Request processed in 101us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1787852932.337324:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787852932.341776:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f491419b0c0 x1874699552305536/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787852948 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787852932.341816:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f491419b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874699552305536:0@lo:13: 00000001:00080000:1.0:1787852932.481185:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:1.0:1787852932.914099:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787852933.929943:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787852934.954709:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787852935.978377:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787852936.942141:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4904cd6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5d48a955-7010-4118-9c7d-f396984ae1ff:3308:1874699552305664:0@lo:400: 00000100:00100000:2.0:1787852936.943814:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787852936.943889:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787852936.943900:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4904cd4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874699552305792:0@lo:400: 00000100:00100000:2.0:1787852936.943942:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787852936.943973:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4904cd43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552305920:0@lo:400: 00000100:00100000:2.0:1787852936.944009:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787852936.944031:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787852936.944036:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4904cd5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1874699552306048:0@lo:400: 00000100:00100000:2.0:1787852936.944054:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787852936.944084:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552305792 00000100:00100000:2.0:1787852936.944092:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552305792 00000100:00100000:2.0:1787852936.944198:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552306048 00000100:00100000:2.0:1787852936.944202:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552306048 00000100:00100000:2.0:1787852936.944293:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787852936.944301:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4904cd7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874699552305792:12345-0@lo:400: 00000100:00100000:2.0:1787852936.944350:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4904cd7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874699552305792:12345-0@lo:400: Request processed in 49us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1787852936.944356:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787852936.944370:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787852936.944375:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4941741e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874699552306048:12345-0@lo:400: 00000100:00100000:2.0:1787852936.944398:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4941741e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874699552306048:12345-0@lo:400: Request processed in 23us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1787852936.944402:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787852936.944419:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552305920 00000100:00100000:2.0:1787852936.944422:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552305920 00000100:00100000:2.0:1787852936.944458:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787852936.944464:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4941742940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874699552305920:12345-0@lo:400: 00000100:00100000:2.0:1787852936.944496:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4941742940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874699552305920:12345-0@lo:400: Request processed in 33us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1787852936.944503:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1787852936.944536:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787852936.944540:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787852936.944566:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f4904cd5a40 x1874699552306048/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787852952 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787852936.944601:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4904cd5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1874699552306048:0@lo:400: 00010000:00080000:2.0:1787852936.944611:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f4904cd43c0 x1874699552305920/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787852952 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787852936.944618:0:3306:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1787852936.944632:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4904cd43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552305920:0@lo:400: 00010000:00080000:2.0:1787852936.944654:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f4904cd4780 x1874699552305792/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787852952 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787852936.944661:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4904cd4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874699552305792:0@lo:400: 00000100:00100000:3.0:1787852936.944758:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552305664 00000100:00100000:3.0:1787852936.944763:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552305664 00000100:00100000:3.0:1787852936.944791:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787852936.944798:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4904f55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d48a955-7010-4118-9c7d-f396984ae1ff+16:3308:x1874699552305664:12345-0@lo:400: 00000100:00100000:3.0:1787852936.944835:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4904f55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d48a955-7010-4118-9c7d-f396984ae1ff+16:3308:x1874699552305664:12345-0@lo:400: Request processed in 38us (1026us total) trans 0 rc 0/0 00000100:00100000:3.0:1787852936.944842:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787852936.945653:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4904cd6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5d48a955-7010-4118-9c7d-f396984ae1ff:3308:1874699552305664:0@lo:400: 00010000:00010000:2.0:1787852937.004757:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787852937.449918:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f491419ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874699552306176:0@lo:13: 00000100:00100000:2.0:1787852937.450007:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787852937.450431:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552306176 00000100:00100000:3.0:1787852937.450440:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552306176 00000100:00100000:3.0:1787852937.450494:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787852937.450517:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4941742580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874699552306176:12345-0@lo:13: 00002000:00000024:3.0:1787852937.450561:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787852937.450652:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4941742580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874699552306176:12345-0@lo:13: Request processed in 148us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1787852937.450659:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787852937.450786:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f491419ad00 x1874699552306176/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787852953 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787852937.450806:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f491419ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874699552306176:0@lo:13: 00010000:00010000:0.0:1787852938.029786:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787852939.051341:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787852940.073919:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787852941.106450:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787852942.061316:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49216952c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5d48a955-7010-4118-9c7d-f396984ae1ff:3309:1874699552306304:0@lo:400: 00000100:00100000:2.0:1787852942.061426:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787852942.061529:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787852942.061537:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4921697840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1874699552306688:0@lo:400: 00000100:00100000:2.0:1787852942.061588:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787852942.061621:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4921694780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874699552306432:0@lo:400: 00000100:00100000:2.0:1787852942.061646:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787852942.061665:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787852942.061671:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4921696d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552306560:0@lo:400: 00000100:00100000:2.0:1787852942.061697:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787852942.061734:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552306688 00000100:00100000:2.0:1787852942.061742:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552306688 00000100:00100000:2.0:1787852942.061796:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552306432 00000100:00100000:2.0:1787852942.061799:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552306432 00000100:00100000:2.0:1787852942.061817:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787852942.061827:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4941743480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874699552306688:12345-0@lo:400: 00000100:00100000:2.0:1787852942.061880:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4941743480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874699552306688:12345-0@lo:400: Request processed in 54us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1787852942.061887:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787852942.061904:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787852942.061910:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4941743c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874699552306432:12345-0@lo:400: 00000100:00100000:2.0:1787852942.061941:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4941743c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874699552306432:12345-0@lo:400: Request processed in 31us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1787852942.061946:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787852942.061964:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552306560 00000100:00100000:2.0:1787852942.061967:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552306560 00000100:00100000:2.0:1787852942.061990:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787852942.061996:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4941740780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874699552306560:12345-0@lo:400: 00000100:00100000:2.0:1787852942.062213:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4941740780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874699552306560:12345-0@lo:400: Request processed in 216us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1787852942.062226:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1787852942.062244:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787852942.062248:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787852942.062280:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f4921697840 x1874699552306688/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787852958 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787852942.062294:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4921697840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1874699552306688:0@lo:400: 00010000:00080000:2.0:1787852942.062319:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f4921696d00 x1874699552306560/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787852958 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787852942.062327:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4921696d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552306560:0@lo:400: 00010000:00080000:2.0:1787852942.062335:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f4921694780 x1874699552306432/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787852958 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787852942.062342:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4921694780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874699552306432:0@lo:400: 00000100:00100000:1.0:1787852942.064265:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552306304 00000100:00100000:1.0:1787852942.064280:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552306304 00000100:00100000:1.0:1787852942.064364:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787852942.064376:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4904f57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+16:3309:x1874699552306304:12345-0@lo:400: 00000100:00100000:1.0:1787852942.064481:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4904f57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+16:3309:x1874699552306304:12345-0@lo:400: Request processed in 107us (3066us total) trans 0 rc 0/0 00000100:00100000:1.0:1787852942.064489:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787852942.065508:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49216952c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5d48a955-7010-4118-9c7d-f396984ae1ff:3309:1874699552306304:0@lo:400: 00010000:00010000:0.0:1787852942.124202:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787852942.571308:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787852942.571334:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f491419b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874699552306816:0@lo:13: 00000100:00100000:3.0:1787852942.571397:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787852942.571467:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552306816 00000100:00100000:3.0:1787852942.571480:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552306816 00000100:00100000:3.0:1787852942.571526:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787852942.571547:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f491419a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874699552306816:12345-0@lo:13: 00002000:00000024:3.0:1787852942.571604:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787852942.571651:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f491419a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874699552306816:12345-0@lo:13: Request processed in 118us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1787852942.571659:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1787852942.571696:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f491419b0c0 x1874699552306816/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787852958 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787852942.571717:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f491419b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874699552306816:0@lo:13: 00010000:00010000:1.0:1787852943.150156:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787852944.171467:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787852945.193873:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787852945.600200:0:7624:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787852945.600205:0:7624:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1787852945.600363:0:7624:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8f493dc01800 00000020:01000004:3.0:1787852945.600384:0:7624:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1787852945.600400:0:7624:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1787852945.600417:0:7624:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8f4941afb3a0) 00000020:00000080:3.0:1787852945.600440:0:7624:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787852945.614381:0:7624:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1787852945.614689:0:7624:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1787852945.635202:0:7624:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1787852945.640193:0:7624:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1787852945.640230:0:7624:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1787852945.640290:0:7624:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1787852945.640328:0:7624:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1787852945.640744:0:7624:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1787852945.640759:0:7624:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787852945.640772:0:7624:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x710df789068e605d 00000020:01000004:3.0:1787852945.640781:0:7624:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1787852945.640805:0:7624:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.101@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787852945.640809:0:7624:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.101@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787852945.640814:0:7624:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1787852945.640839:0:7624:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1787852945.640844:0:7624:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.101@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1787852945.656864:0:7624:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.101@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787852945.656906:0:7624:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.101@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1787852945.656910:0:7624:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787852945.656912:0:7624:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787852945.656914:0:7624:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787852945.656916:0:7624:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787852945.656917:0:7624:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787852945.656918:0:7624:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787852945.656920:0:7624:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787852945.656922:0:7624:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787852945.656924:0:7624:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787852945.656925:0:7624:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787852945.656927:0:7624:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787852945.656931:0:7624:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1787852945.656933:0:7624:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787852945.656938:0:7624:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787852945.656939:0:7624:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787852945.656940:0:7624:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787852945.656941:0:7624:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787852945.656942:0:7624:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787852945.656943:0:7624:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787852945.656944:0:7624:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787852945.656946:0:7624:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787852945.657023:0:7624:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787852945.657026:0:7624:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787852945.657053:0:7624:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787852945.657072:0:7624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49417412c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d48a955-7010-4118-9c7d-f396984ae1ff:7624:1874699552306944:0@lo:253: 00000100:00100000:2.0:1787852945.657154:0:7624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787852945.657288:0:7624:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f4910dbb000 going to sleep for 11 seconds 00000100:00100000:3.0:1787852945.657400:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552306944 00000100:00100000:3.0:1787852945.657408:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552306944 00000100:00100000:3.0:1787852945.657508:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787852945.657519:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4904f56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+16:7624:x1874699552306944:12345-0@lo:253: 20000000:01000000:3.0:1787852945.657560:0:5829:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1787852945.657564:0:5829:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:3.0:1787852945.657762:0:5829:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:3.0:1787852945.657766:0:5829:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:3.0:1787852945.659086:0:5829:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787852945.659305:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:3.0:1787852945.659319:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:3.0:1787852945.659381:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:3.0:1787852945.659397:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:3.0:1787852945.659431:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:3.0:1787852945.659481:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:3.0:1787852945.660021:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:3.0:1787852945.660044:0:5829:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.101@tcp 20000000:01000000:3.0:1787852945.660046:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.101@tcp (null) (null) (null) 00000040:00080000:3.0:1787852945.660083:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:3.0:1787852945.660091:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1787852945.660137:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:3.0:1787852945.660145:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.204.101@tcp (null) (null) 00000040:00080000:3.0:1787852945.660177:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:3.0:1787852945.660186:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1787852945.660216:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:3.0:1787852945.660293:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:3.0:1787852945.661153:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:3.0:1787852945.661170:0:5829:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.101@tcp 20000000:01000000:3.0:1787852945.661172:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.101@tcp (null) (null) (null) 00000040:00080000:3.0:1787852945.661200:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:3.0:1787852945.661207:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1787852945.661236:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:3.0:1787852945.661243:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.204.101@tcp (null) (null) 00000040:00080000:3.0:1787852945.661272:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:3.0:1787852945.661280:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1787852945.661315:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:3.0:1787852945.661354:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:3.0:1787852945.661369:0:5829:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:3.0:1787852945.661372:0:5829:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:3.0:1787852945.661377:0:5829:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1787852945.661379:0:5829:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1787852945.661381:0:5829:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1787852945.661393:0:5829:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787852945.661402:0:5829:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1787852945.661434:0:5829:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1787852945.661437:0:5829:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:0.0:1787852945.662121:0:7626:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:3.0:1787852945.662402:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:3.0:1787852945.662454:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:3.0:1787852945.662510:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:3.0:1787852945.662521:0:5829:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1787852945.662523:0:5829:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787852945.663142:0:7627:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 14 1->4: lustre sys.timeout 20000000:01000000:0.0:1787852945.663188:0:7627:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 14 2->4: lustre sys.timeout 00000040:00080000:0.0:1787852945.663240:0:7627:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:3.0:1787852945.663458:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:3.0:1787852945.663494:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:3.0:1787852945.663561:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:3.0:1787852945.663682:0:5829:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1787852945.663685:0:5829:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787852945.664139:0:7628:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:0.0:1787852945.664182:0:7628:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:0.0:1787852945.664230:0:7628:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:3.0:1787852945.664459:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:3.0:1787852945.664495:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:3.0:1787852945.664529:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:3.0:1787852945.664540:0:5829:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1787852945.664541:0:5829:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787852945.665360:0:7629:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 16 1->4: lustre sys.timeout 20000000:01000000:3.0:1787852945.665433:0:7629:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 16 2->4: lustre sys.timeout 00000040:00080000:3.0:1787852945.665468:0:7629:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:0.0:1787852945.665828:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:0.0:1787852945.665871:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:0.0:1787852945.665931:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 10000000:01000000:0.0:1787852945.666025:0:5829:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1787852945.666050:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f4900031e00/0x710df789068e6064 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852945.666070:0:5829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f49421e3600/0x710df789068e5f99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x710df789068e5f92 expref: 16 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852945.666079:0:5829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f49013fda00/0x710df789068e5fa7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x710df789068e5fa0 expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852945.666094:0:5829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f49029cce00/0x710df789068e5fd8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x710df789068e5fd1 expref: 16 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852945.666101:0:5829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f4900031a00/0x710df789068e5ff4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x710df789068e5fed expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852945.666107:0:5829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f49029cc000/0x710df789068e601e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x710df789068e6017 expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852945.666114:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f4900031e00/0x710df789068e6064 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852945.666157:0:5829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f49029cc000/0x710df789068e601e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x710df789068e6017 expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852945.666174:0:5829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f49029cc000/0x710df789068e601e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x710df789068e6017 expref: 16 pid: 5831 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787852945.666190:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49216e5680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5829:1874699552307072:0@lo:104: 00000100:00100000:0.0:1787852945.666269:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787852945.666389:0:5829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f4900031a00/0x710df789068e5ff4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x710df789068e5fed expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852945.666397:0:5829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f4900031a00/0x710df789068e5ff4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x710df789068e5fed expref: 16 pid: 5830 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787852945.666406:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49216e7c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5829:1874699552307200:0@lo:104: 00000100:00100000:0.0:1787852945.666443:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787852945.666627:0:5829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f49029cce00/0x710df789068e5fd8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x710df789068e5fd1 expref: 16 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852945.666641:0:5829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f49029cce00/0x710df789068e5fd8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x710df789068e5fd1 expref: 16 pid: 5829 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787852945.666650:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49079f1e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5829:1874699552307328:0@lo:104: 00000100:00100000:0.0:1787852945.666673:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787852945.666751:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552307072 00000100:00100000:1.0:1787852945.666758:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552307072 00000100:00100000:2.0:1787852945.666847:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552307200 00000100:00100000:2.0:1787852945.666851:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552307200 00000100:00100000:2.0:1787852945.666874:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787852945.666884:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49216e4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5d48a955-7010-4118-9c7d-f396984ae1ff+4:5829:x1874699552307072:12345-0@lo:104: 00010000:00010000:2.0:1787852945.666896:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.101@tcp lock: ffff8f49029cd200/0x710df789068e6017 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x710df789068e601e expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787852945.667055:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787852945.667062:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49216e4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5d48a955-7010-4118-9c7d-f396984ae1ff+4:5829:x1874699552307072:12345-0@lo:104: Request processed in 180us (794us total) trans 0 rc 0/0 00000100:00100000:2.0:1787852945.667069:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787852945.667086:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787852945.667092:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49079f2940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5d48a955-7010-4118-9c7d-f396984ae1ff+3:5829:x1874699552307200:12345-0@lo:104: 00010000:00010000:2.0:1787852945.667100:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.101@tcp lock: ffff8f4900030e00/0x710df789068e5fed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x710df789068e5ff4 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787852945.667166:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787852945.667171:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49079f2940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5d48a955-7010-4118-9c7d-f396984ae1ff+3:5829:x1874699552307200:12345-0@lo:104: Request processed in 80us (729us total) trans 0 rc 0/0 00000100:00100000:2.0:1787852945.667182:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787852945.667275:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552307328 00000100:00100000:1.0:1787852945.667280:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552307328 00000100:00100000:1.0:1787852945.667295:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787852945.667301:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49079f2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5d48a955-7010-4118-9c7d-f396984ae1ff+3:5829:x1874699552307328:12345-0@lo:104: 00010000:00010000:1.0:1787852945.667308:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.101@tcp lock: ffff8f49029cc400/0x710df789068e5fd1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x710df789068e5fd8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852945.667364:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787852945.667372:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.101@tcp lock: ffff8f49029cd200/0x710df789068e6017 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x710df789068e601e expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852945.667380:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49029cd200 already unused, calling callback (ffffffffc1b55c20) 10000000:00010000:3.0:1787852945.667385:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.101@tcp lock: ffff8f49029cd200/0x710df789068e6017 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x710df789068e601e expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852945.667394:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.101@tcp lock: ffff8f49029cd200/0x710df789068e6017 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x710df789068e601e expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787852945.667400:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.101@tcp lock: ffff8f49029cd200/0x710df789068e6017 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x710df789068e601e expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787852945.667413:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787852945.667452:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.101@tcp lock: ffff8f49029cd200/0x710df789068e6017 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x710df789068e601e expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852945.667458:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787852945.667477:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.101@tcp lock: ffff8f49029cd200/0x710df789068e6017 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x710df789068e601e expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852945.667484:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.101@tcp lock: ffff8f49029cd200/0x710df789068e6017 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x710df789068e601e expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852945.667499:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787852945.667502:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.101@tcp lock: ffff8f4900030e00/0x710df789068e5fed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x710df789068e5ff4 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852945.667507:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4900030e00 already unused, calling callback (ffffffffc1b55c20) 10000000:00010000:3.0:1787852945.667510:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.101@tcp lock: ffff8f4900030e00/0x710df789068e5fed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x710df789068e5ff4 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852945.667516:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.101@tcp lock: ffff8f4900030e00/0x710df789068e5fed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x710df789068e5ff4 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787852945.667523:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.101@tcp lock: ffff8f4900030e00/0x710df789068e5fed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x710df789068e5ff4 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787852945.667528:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787852945.667542:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.101@tcp lock: ffff8f4900030e00/0x710df789068e5fed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x710df789068e5ff4 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852945.667548:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787852945.667562:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.101@tcp lock: ffff8f4900030e00/0x710df789068e5fed lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x710df789068e5ff4 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852945.667592:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.101@tcp lock: ffff8f4900030e00/0x710df789068e5fed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x710df789068e5ff4 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852945.667605:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787852945.667608:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.101@tcp lock: ffff8f49029cc400/0x710df789068e5fd1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x710df789068e5fd8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852945.667614:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49029cc400 already unused, calling callback (ffffffffc1b55c20) 10000000:00010000:3.0:1787852945.667616:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.101@tcp lock: ffff8f49029cc400/0x710df789068e5fd1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x710df789068e5fd8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852945.667623:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.101@tcp lock: ffff8f49029cc400/0x710df789068e5fd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x710df789068e5fd8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787852945.667629:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.101@tcp lock: ffff8f49029cc400/0x710df789068e5fd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x710df789068e5fd8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787852945.667635:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787852945.667649:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.101@tcp lock: ffff8f49029cc400/0x710df789068e5fd1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x710df789068e5fd8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852945.667654:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787852945.667669:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.101@tcp lock: ffff8f49029cc400/0x710df789068e5fd1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x710df789068e5fd8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852945.667675:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.101@tcp lock: ffff8f49029cc400/0x710df789068e5fd1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x710df789068e5fd8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852945.667685:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787852945.667692:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787852945.667694:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787852945.667717:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f491419b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5d48a955-7010-4118-9c7d-f396984ae1ff:3306:1874699552307456:0@lo:103: 00000100:00100000:3.0:1787852945.667754:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787852945.667777:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787852945.667782:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4914199e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5d48a955-7010-4118-9c7d-f396984ae1ff:3306:1874699552307584:0@lo:103: 00000100:00100000:3.0:1787852945.667802:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787852945.667831:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f491419bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5d48a955-7010-4118-9c7d-f396984ae1ff:3308:1874699552307712:0@lo:103: 00000100:00100000:3.0:1787852945.667906:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787852945.667943:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552307456 00000100:00100000:3.0:1787852945.667959:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552307456 00010000:00010000:3.0:1787852945.667983:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f49029cc000/0x710df789068e601e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x710df789068e6017 expref: 17 pid: 5831 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787852945.667999:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552307584 00000100:00100000:3.0:1787852945.668002:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552307584 00010000:00010000:3.0:1787852945.668011:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f4900031a00/0x710df789068e5ff4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x710df789068e5fed expref: 18 pid: 5830 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787852945.668022:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552307712 00000100:00100000:3.0:1787852945.668024:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552307712 00010000:00010000:3.0:1787852945.668033:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f49029cce00/0x710df789068e5fd8 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x710df789068e5fd1 expref: 19 pid: 5829 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787852945.668044:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787852945.668049:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f491e972450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d48a955-7010-4118-9c7d-f396984ae1ff+19:3306:x1874699552307456:12345-0@lo:103: 00010000:00010000:3.0:1787852945.668059:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787852945.668063:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f49029cc000/0x710df789068e601e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x710df789068e6017 expref: 19 pid: 5831 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852945.668083:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f49029cc000/0x710df789068e601e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x710df789068e6017 expref: 19 pid: 5831 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852945.668104:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787852945.668132:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f491e972450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d48a955-7010-4118-9c7d-f396984ae1ff+19:3306:x1874699552307456:12345-0@lo:103: Request processed in 83us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1787852945.668140:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787852945.668189:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787852945.668196:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4914199680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d48a955-7010-4118-9c7d-f396984ae1ff+18:3306:x1874699552307584:12345-0@lo:103: 00010000:00010000:3.0:1787852945.668204:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787852945.668208:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f4900031a00/0x710df789068e5ff4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x710df789068e5fed expref: 18 pid: 5830 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852945.668215:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f4900031a00/0x710df789068e5ff4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x710df789068e5fed expref: 18 pid: 5830 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852945.668225:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787852945.668244:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4914199680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d48a955-7010-4118-9c7d-f396984ae1ff+18:3306:x1874699552307584:12345-0@lo:103: Request processed in 49us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1787852945.668250:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787852945.668260:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787852945.668265:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f491419ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d48a955-7010-4118-9c7d-f396984ae1ff+17:3308:x1874699552307712:12345-0@lo:103: 00010000:00010000:3.0:1787852945.668271:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787852945.668275:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f49029cce00/0x710df789068e5fd8 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x710df789068e5fd1 expref: 17 pid: 5829 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852945.668284:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f49029cce00/0x710df789068e5fd8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x710df789068e5fd1 expref: 17 pid: 5829 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852945.668299:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787852945.668322:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f491419ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d48a955-7010-4118-9c7d-f396984ae1ff+17:3308:x1874699552307712:12345-0@lo:103: Request processed in 57us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1787852945.668328:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787852945.669070:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f491419bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5d48a955-7010-4118-9c7d-f396984ae1ff:3308:1874699552307712:0@lo:103: 00000100:00100000:3.0:1787852945.669103:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4914199e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5d48a955-7010-4118-9c7d-f396984ae1ff:3306:1874699552307584:0@lo:103: 00000100:00100000:3.0:1787852945.669112:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f491419b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5d48a955-7010-4118-9c7d-f396984ae1ff:3306:1874699552307456:0@lo:103: 00010000:00010000:0.0:1787852945.669177:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787852945.669221:0:5829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f49013fda00/0x710df789068e5fa7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x710df789068e5fa0 expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852945.669236:0:5829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f49013fda00/0x710df789068e5fa7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x710df789068e5fa0 expref: 16 pid: 5831 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787852945.669247:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49079f2d00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5829:1874699552307840:0@lo:104: 00000100:00100000:0.0:1787852945.669298:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787852945.669383:0:5829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f49421e3600/0x710df789068e5f99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x710df789068e5f92 expref: 16 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852945.669391:0:5829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f49421e3600/0x710df789068e5f99 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x710df789068e5f92 expref: 16 pid: 5829 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787852945.669399:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49079f3c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5829:1874699552307968:0@lo:104: 00000100:00100000:0.0:1787852945.669419:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787852945.669448:0:5820:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00010000:00010000:1.0:1787852945.669503:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:1.0:1787852945.669514:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49079f2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5d48a955-7010-4118-9c7d-f396984ae1ff+3:5829:x1874699552307328:12345-0@lo:104: Request processed in 2211us (2838us total) trans 0 rc 0/0 00000100:00100000:1.0:1787852945.669522:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:3.0:1787852945.669558:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787852945.669833:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f4911533d80 going to sleep for 11 seconds 00010000:00010000:0.0:1787852945.669850:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f49029cc000/0x710df789068e601e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x710df789068e6017 expref: 16 pid: 5831 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787852945.669867:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49216e5680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5829:1874699552307072:0@lo:104: 00010000:00010000:0.0:1787852945.669878:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f4900031a00/0x710df789068e5ff4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x710df789068e5fed expref: 15 pid: 5830 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787852945.669905:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49216e7c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5829:1874699552307200:0@lo:104: 00010000:00010000:0.0:1787852945.669918:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f49029cce00/0x710df789068e5fd8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x710df789068e5fd1 expref: 14 pid: 5829 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787852945.669926:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49079f1e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5829:1874699552307328:0@lo:104: 00000100:00100000:2.0:1787852945.670040:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00000100:00100000:2.0:1787852945.670252:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552307840 00000100:00100000:2.0:1787852945.670259:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552307840 00000100:00100000:2.0:1787852945.670298:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552307968 00000100:00100000:2.0:1787852945.670301:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552307968 00000100:00100000:2.0:1787852945.670316:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787852945.670325:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49079f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5d48a955-7010-4118-9c7d-f396984ae1ff+4:5829:x1874699552307840:12345-0@lo:104: 00010000:00010000:2.0:1787852945.670337:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.101@tcp lock: ffff8f49421e2200/0x710df789068e5fa0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x710df789068e5fa7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787852945.670419:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787852945.670424:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49079f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5d48a955-7010-4118-9c7d-f396984ae1ff+4:5829:x1874699552307840:12345-0@lo:104: Request processed in 102us (1127us total) trans 0 rc 0/0 00000100:00100000:2.0:1787852945.670429:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787852945.670442:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787852945.670448:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49079f0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5d48a955-7010-4118-9c7d-f396984ae1ff+3:5829:x1874699552307968:12345-0@lo:104: 00010000:00010000:2.0:1787852945.670457:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.101@tcp lock: ffff8f49013fc800/0x710df789068e5f92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x710df789068e5f99 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787852945.670489:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787852945.670494:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49079f0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5d48a955-7010-4118-9c7d-f396984ae1ff+3:5829:x1874699552307968:12345-0@lo:104: Request processed in 47us (1075us total) trans 0 rc 0/0 00000100:00100000:2.0:1787852945.670499:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:2.0:1787852945.670514:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787852945.670520:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.101@tcp lock: ffff8f49421e2200/0x710df789068e5fa0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x710df789068e5fa7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787852945.670538:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49421e2200 already unused, calling callback (ffffffffc1b55c20) 10000000:00010000:2.0:1787852945.670542:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.101@tcp lock: ffff8f49421e2200/0x710df789068e5fa0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x710df789068e5fa7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787852945.670550:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.101@tcp lock: ffff8f49421e2200/0x710df789068e5fa0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x710df789068e5fa7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787852945.670557:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.101@tcp lock: ffff8f49421e2200/0x710df789068e5fa0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x710df789068e5fa7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787852945.670563:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787852945.670618:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.101@tcp lock: ffff8f49421e2200/0x710df789068e5fa0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x710df789068e5fa7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787852945.670625:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787852945.670638:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.101@tcp lock: ffff8f49421e2200/0x710df789068e5fa0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x710df789068e5fa7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787852945.670645:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.101@tcp lock: ffff8f49421e2200/0x710df789068e5fa0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x710df789068e5fa7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787852945.670657:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787852945.670660:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.101@tcp lock: ffff8f49013fc800/0x710df789068e5f92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x710df789068e5f99 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787852945.670665:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49013fc800 already unused, calling callback (ffffffffc1b55c20) 10000000:00010000:2.0:1787852945.670668:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.101@tcp lock: ffff8f49013fc800/0x710df789068e5f92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x710df789068e5f99 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787852945.670688:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.101@tcp lock: ffff8f49013fc800/0x710df789068e5f92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x710df789068e5f99 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787852945.670694:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.101@tcp lock: ffff8f49013fc800/0x710df789068e5f92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x710df789068e5f99 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787852945.670700:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787852945.670712:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.101@tcp lock: ffff8f49013fc800/0x710df789068e5f92 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x710df789068e5f99 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787852945.670718:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787852945.670727:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.101@tcp lock: ffff8f49013fc800/0x710df789068e5f92 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x710df789068e5f99 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787852945.670735:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.101@tcp lock: ffff8f49013fc800/0x710df789068e5f92 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x710df789068e5f99 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787852945.670750:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787852945.670751:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787852945.670752:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787852945.670805:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787852945.670819:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4941741a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5d48a955-7010-4118-9c7d-f396984ae1ff:3307:1874699552308224:0@lo:103: 00000100:00100000:3.0:1787852945.670852:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787852945.670888:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4941740f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5d48a955-7010-4118-9c7d-f396984ae1ff:3309:1874699552308096:0@lo:103: 00000100:00100000:3.0:1787852945.670909:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787852945.670943:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552308224 00000100:00100000:3.0:1787852945.670957:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552308224 00010000:00010000:3.0:1787852945.670977:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f49421e3600/0x710df789068e5f99 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x710df789068e5f92 expref: 14 pid: 5829 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787852945.670995:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552308096 00000100:00100000:3.0:1787852945.670998:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552308096 00010000:00010000:3.0:1787852945.671007:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f49013fda00/0x710df789068e5fa7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x710df789068e5fa0 expref: 15 pid: 5831 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787852945.671020:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787852945.671026:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f491419b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5d48a955-7010-4118-9c7d-f396984ae1ff+15:3307:x1874699552308224:12345-0@lo:103: 00010000:00010000:3.0:1787852945.671036:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787852945.671047:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f49421e3600/0x710df789068e5f99 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x710df789068e5f92 expref: 15 pid: 5829 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852945.671057:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f49421e3600/0x710df789068e5f99 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x710df789068e5f92 expref: 15 pid: 5829 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852945.671072:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787852945.671099:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f491419b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5d48a955-7010-4118-9c7d-f396984ae1ff+15:3307:x1874699552308224:12345-0@lo:103: Request processed in 74us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1787852945.671105:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787852945.671118:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787852945.671124:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4914199e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5d48a955-7010-4118-9c7d-f396984ae1ff+14:3309:x1874699552308096:12345-0@lo:103: 00010000:00010000:3.0:1787852945.671131:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787852945.671135:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f49013fda00/0x710df789068e5fa7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x710df789068e5fa0 expref: 14 pid: 5831 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852945.671144:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f49013fda00/0x710df789068e5fa7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x710df789068e5fa0 expref: 14 pid: 5831 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852945.671156:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f4900031e00/0x710df789068e6064 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852945.671165:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f4900031e00/0x710df789068e6064 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852945.671179:0:5823:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f4900031e00/0x710df789068e6064 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852945.671187:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f4900031e00/0x710df789068e6064 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852945.671194:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f4900031e00/0x710df789068e6064 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852945.671205:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f4900031e00/0x710df789068e6064 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852945.671211:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4900031e00 already unused, calling callback (ffffffffc1528440) 00010000:00010000:3.0:1787852945.671214:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f4900031e00/0x710df789068e6064 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852945.671222:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f4900031e00/0x710df789068e6064 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852945.671230:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f4900031e00/0x710df789068e6064 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852945.671240:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787852945.671264:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4914199e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5d48a955-7010-4118-9c7d-f396984ae1ff+14:3309:x1874699552308096:12345-0@lo:103: Request processed in 141us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1787852945.671270:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787852945.671301:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4941740f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5d48a955-7010-4118-9c7d-f396984ae1ff:3309:1874699552308096:0@lo:103: 00000100:00100000:3.0:1787852945.671323:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4941741a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5d48a955-7010-4118-9c7d-f396984ae1ff:3307:1874699552308224:0@lo:103: 00010000:00010000:3.0:1787852945.671353:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787852945.671374:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f49013fda00/0x710df789068e5fa7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x710df789068e5fa0 expref: 13 pid: 5831 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787852945.671384:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49079f2d00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5829:1874699552307840:0@lo:104: 00010000:00010000:3.0:1787852945.671393:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f49421e3600/0x710df789068e5f99 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x710df789068e5f92 expref: 12 pid: 5829 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787852945.671399:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49079f3c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5829:1874699552307968:0@lo:104: 00010000:00010000:3.0:1787852945.671429:0:5829:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f4900031e00/0x710df789068e6064 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852945.671437:0:5829:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f4900031e00/0x710df789068e6064 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852945.671443:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f4900031e00/0x710df789068e6064 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852945.671448:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f4900031e00/0x710df789068e6064 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787852945.671461:0:5829:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1787852945.708744:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4904f56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+11:7624:x1874699552306944:12345-0@lo:253: Request processed in 51218us (51581us total) trans 0 rc 0/0 00000100:00100000:0.0:1787852945.708758:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787852945.708900:0:7624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49417412c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d48a955-7010-4118-9c7d-f396984ae1ff:7624:1874699552306944:0@lo:253: 10000000:01000000:2.0:1787852945.708916:0:7624:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1787852945.708919:0:7624:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787852945.708921:0:7624:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787852945.708922:0:7624:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787852945.709031:0:7624:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:2.0:1787852945.709033:0:7624:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787852945.709035:0:7624:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787852945.709037:0:7624:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787852945.709039:0:7624:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1787852945.709040:0:7624:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787852945.709056:0:7624:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787852945.709083:0:7624:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8f493dc01800 from lustre-OST0001 10000000:01000000:2.0:1787852945.709112:0:7624:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1787852945.709115:0:7624:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1787852945.709123:0:7624:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8f490300cd70 local copy 10000000:01000000:2.0:1787852945.709128:0:7624:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787852945.709174:0:7624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f49013fc800/0x710df789068e606b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787852945.709185:0:7624:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.101@tcp lock: ffff8f49013fc800/0x710df789068e606b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787852945.709193:0:7624:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: ffff8f49013fc800/0x710df789068e606b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787852945.709213:0:7624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49417412c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d48a955-7010-4118-9c7d-f396984ae1ff:7624:1874699552308352:0@lo:101: 00000100:00100000:2.0:1787852945.709254:0:7624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787852945.709358:0:7624:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f4910dbbf00 going to sleep for 11 seconds 00000100:00100000:3.0:1787852945.709403:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552308352 00000100:00100000:3.0:1787852945.709412:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552308352 00000100:00100000:3.0:1787852945.709508:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787852945.709521:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4904f51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d48a955-7010-4118-9c7d-f396984ae1ff+11:7624:x1874699552308352:12345-0@lo:101: 00010000:00010000:3.0:1787852945.709535:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787852945.709552:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f49029cc400/0x710df789068e6072 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x710df789068e606b expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852945.709598:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f49029cc400/0x710df789068e6072 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x710df789068e606b expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852945.709609:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f49029cc400/0x710df789068e6072 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x710df789068e606b expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852945.709619:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49029cc400, rc 0) 00000100:00100000:3.0:1787852945.709660:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4904f51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d48a955-7010-4118-9c7d-f396984ae1ff+12:7624:x1874699552308352:12345-0@lo:101: Request processed in 142us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1787852945.709678:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787852945.709753:0:7624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49417412c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d48a955-7010-4118-9c7d-f396984ae1ff:7624:1874699552308352:0@lo:101: 00010000:00010000:2.0:1787852945.709768:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: ffff8f49013fc800/0x710df789068e606b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x710df789068e6072 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787852945.709776:0:7624:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: ffff8f49013fc800/0x710df789068e606b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x710df789068e6072 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787852945.709890:0:7624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49417412c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d48a955-7010-4118-9c7d-f396984ae1ff:7624:1874699552308480:0@lo:501: 00000100:00100000:2.0:1787852945.709944:0:7624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787852945.710312:0:7624:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f4910dbbf00 going to sleep for 11 seconds 00000100:00100000:1.0:1787852945.710403:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552308480 00000100:00100000:1.0:1787852945.710408:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552308480 00000100:00100000:1.0:1787852945.710436:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787852945.710443:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4904f52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+12:7624:x1874699552308480:12345-0@lo:501: 00000100:00100000:1.0:1787852945.710726:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4904f52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+12:7624:x1874699552308480:12345-0@lo:501: Request processed in 283us (781us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787852945.710735:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787852945.710841:0:7624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49417412c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d48a955-7010-4118-9c7d-f396984ae1ff:7624:1874699552308480:0@lo:501: 10000000:01000000:2.0:1787852945.710861:0:7624:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.101@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787852945.710898:0:7624:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.101@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787852945.710905:0:7624:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f49013fc800/0x710df789068e606b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x710df789068e6072 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787852945.710913:0:7624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f49013fc800/0x710df789068e606b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x710df789068e6072 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787852945.710920:0:7624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.101@tcp lock: ffff8f49013fc800/0x710df789068e606b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x710df789068e6072 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787852945.711144:0:7624:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787852945.711176:0:7624:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8f493dc01800 10000000:01000000:2.0:1787852945.711183:0:7624:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787852945.711190:0:7624:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1787852945.711193:0:7624:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787852945.711198:0:7624:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1787852945.711201:0:7624:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1787852945.711227:0:7624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f49013fd200/0x710df789068e6079 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787852945.711237:0:7624:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.101@tcp lock: ffff8f49013fd200/0x710df789068e6079 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787852945.711245:0:7624:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: ffff8f49013fd200/0x710df789068e6079 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787852945.711259:0:7624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49417412c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d48a955-7010-4118-9c7d-f396984ae1ff:7624:1874699552308608:0@lo:101: 00000100:00100000:2.0:1787852945.711290:0:7624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787852945.711314:0:7624:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f4910dbb540 going to sleep for 11 seconds 00010000:00010000:1.0:1787852945.712310:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787852945.712321:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.101@tcp lock: ffff8f49013fc800/0x710df789068e606b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x710df789068e6072 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852945.712330:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49013fc800 already unused, calling callback (ffffffffc1b55c20) 10000000:00010000:1.0:1787852945.712334:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.101@tcp lock: ffff8f49013fc800/0x710df789068e606b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x710df789068e6072 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852945.712761:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.101@tcp lock: ffff8f49013fc800/0x710df789068e606b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x710df789068e6072 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787852945.712768:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.101@tcp lock: ffff8f49013fc800/0x710df789068e606b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x710df789068e6072 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787852945.712775:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787852945.712812:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.101@tcp lock: ffff8f49013fc800/0x710df789068e606b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x710df789068e6072 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852945.712819:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787852945.712845:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.101@tcp lock: ffff8f49013fc800/0x710df789068e606b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x710df789068e6072 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852945.712853:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.101@tcp lock: ffff8f49013fc800/0x710df789068e606b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x710df789068e6072 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852945.712870:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787852945.712872:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787852945.712887:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787852945.712915:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552308608 00000100:00100000:1.0:1787852945.712932:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552308608 00000100:00100000:1.0:1787852945.713075:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787852945.713085:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4904f53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+12:7624:x1874699552308608:12345-0@lo:101: 00010000:00010000:1.0:1787852945.713098:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787852945.713113:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f49421e2400/0x710df789068e6080 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x710df789068e6079 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852945.713136:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f49421e2400/0x710df789068e6080 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x710df789068e6079 expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852945.713148:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f49421e2400/0x710df789068e6080 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x710df789068e6079 expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852945.713156:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49421e2400, rc 0) 00000100:00100000:1.0:1787852945.713212:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4904f53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+13:7624:x1874699552308608:12345-0@lo:101: Request processed in 129us (1920us total) trans 0 rc 0/0 00000100:00100000:1.0:1787852945.713218:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787852945.713302:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4921695e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5d48a955-7010-4118-9c7d-f396984ae1ff:3307:1874699552308736:0@lo:103: 00000100:00100000:2.0:1787852945.713355:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787852945.713434:0:7624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49417412c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d48a955-7010-4118-9c7d-f396984ae1ff:7624:1874699552308608:0@lo:101: 00010000:00010000:2.0:1787852945.713450:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: ffff8f49013fd200/0x710df789068e6079 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e6080 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787852945.713460:0:7624:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: ffff8f49013fd200/0x710df789068e6079 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x710df789068e6080 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787852945.713561:0:7624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49417412c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d48a955-7010-4118-9c7d-f396984ae1ff:7624:1874699552308864:0@lo:501: 00000100:00100000:2.0:1787852945.713624:0:7624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787852945.713638:0:7624:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f4910dbb540 going to sleep for 11 seconds 00000100:00100000:1.0:1787852945.713764:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552308736 00000100:00100000:1.0:1787852945.713770:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552308736 00000100:00100000:1.0:1787852945.713809:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787852945.713817:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4941740000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5d48a955-7010-4118-9c7d-f396984ae1ff+13:3307:x1874699552308736:12345-0@lo:103: 00010000:00010000:1.0:1787852945.713826:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787852945.713842:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f49029cc400/0x710df789068e6072 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x710df789068e606b expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852945.713854:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787852945.713886:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4941740000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5d48a955-7010-4118-9c7d-f396984ae1ff+12:3307:x1874699552308736:12345-0@lo:103: Request processed in 71us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1787852945.713900:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787852945.713943:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4921695e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5d48a955-7010-4118-9c7d-f396984ae1ff:3307:1874699552308736:0@lo:103: 00000100:00100000:1.0:1787852945.714083:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552308864 00000100:00100000:1.0:1787852945.714087:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552308864 00000100:00100000:1.0:1787852945.714103:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787852945.714108:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4904f53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+12:7624:x1874699552308864:12345-0@lo:501: 00000100:00100000:1.0:1787852945.714363:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4904f53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+12:7624:x1874699552308864:12345-0@lo:501: Request processed in 254us (737us total) trans 0 rc 0/0 00000100:00100000:1.0:1787852945.714371:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787852945.714471:0:7624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49417412c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d48a955-7010-4118-9c7d-f396984ae1ff:7624:1874699552308864:0@lo:501: 00000100:00100000:2.0:1787852945.714509:0:7624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49417412c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d48a955-7010-4118-9c7d-f396984ae1ff:7624:1874699552308992:0@lo:503: 00000100:00100000:2.0:1787852945.714549:0:7624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787852945.714604:0:7624:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f4910dbb540 going to sleep for 11 seconds 00000100:00100000:1.0:1787852945.714685:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552308992 00000100:00100000:1.0:1787852945.714690:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552308992 00000100:00100000:1.0:1787852945.714766:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787852945.714772:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4904f52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+12:7624:x1874699552308992:12345-0@lo:503: 00000100:00100000:2.0:1787852945.715084:0:7624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49417412c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d48a955-7010-4118-9c7d-f396984ae1ff:7624:1874699552308992:0@lo:503: 00000040:00080000:2.0:1787852945.715425:0:7624:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787852945.715496:0:7624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49417412c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d48a955-7010-4118-9c7d-f396984ae1ff:7624:1874699552309120:0@lo:502: 00000100:00100000:2.0:1787852945.715532:0:7624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787852945.715552:0:7624:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f4910dbb540 going to sleep for 11 seconds 00000100:00100000:1.0:1787852945.715670:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4904f52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+12:7624:x1874699552308992:12345-0@lo:503: Request processed in 152us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1787852945.715681:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787852945.715725:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552309120 00000100:00100000:1.0:1787852945.715729:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552309120 00000100:00100000:1.0:1787852945.715751:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787852945.715757:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4904f52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+12:7624:x1874699552309120:12345-0@lo:502: 00000100:00100000:1.0:1787852945.715896:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4904f52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+12:7624:x1874699552309120:12345-0@lo:502: Request processed in 139us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1787852945.715903:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787852945.716099:0:7624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49417412c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d48a955-7010-4118-9c7d-f396984ae1ff:7624:1874699552309120:0@lo:502: 00000040:00080000:2.0:1787852945.716371:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1787852945.716415:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1787852945.716440:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1787852945.716475:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1787852945.716503:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1787852945.716540:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1787852945.716563:0:7624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49417412c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d48a955-7010-4118-9c7d-f396984ae1ff:7624:1874699552309248:0@lo:502: 00000100:00100000:2.0:1787852945.716634:0:7624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787852945.716664:0:7624:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f4910dbb540 going to sleep for 11 seconds 00000100:00100000:1.0:1787852945.716735:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552309248 00000100:00100000:1.0:1787852945.716742:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552309248 00000100:00100000:1.0:1787852945.716765:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787852945.716778:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4904f51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+12:7624:x1874699552309248:12345-0@lo:502: 00000100:00100000:1.0:1787852945.716911:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4904f51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+12:7624:x1874699552309248:12345-0@lo:502: Request processed in 134us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1787852945.716918:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787852945.717092:0:7624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49417412c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d48a955-7010-4118-9c7d-f396984ae1ff:7624:1874699552309248:0@lo:502: 00000040:00080000:2.0:1787852945.717179:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1787852945.717188:0:7624:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:2.0:1787852945.718162:0:7632:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787852945.718175:0:7632:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1787852945.718185:0:7632:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787852945.718189:0:7632:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1787852945.718195:0:7632:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787852945.718231:0:7632:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8f493ffe19d0) 00000020:00000080:2.0:1787852945.718261:0:7632:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:2.0:1787852945.718268:0:7632:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787852945.718336:0:7632:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f493dc01800 from lustre-OST0001, refs=2 00080000:01000000:2.0:1787852945.718355:0:7632:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787852945.718363:0:7632:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x710df789068e608e 00010000:00010000:2.0:1787852945.722852:0:7632:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:2.0:1787852945.723321:0:7632:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:2.0:1787852945.726520:0:7632:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1787852945.727369:0:7632:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:2.0:1787852945.736252:0:7632:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1787852945.736818:0:7632:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1787852945.741118:0:7632:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1787852945.741136:0:7632:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787852945.741143:0:7632:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787852945.741145:0:7632:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1787852945.741149:0:7632:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787852945.741153:0:7632:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787852945.741154:0:7632:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787852945.741168:0:7632:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787852945.741170:0:7632:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787852945.741235:0:7632:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787852945.741238:0:7632:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787852945.741239:0:7632:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787852945.741243:0:7632:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1787852945.742910:0:7624:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:3.0:1787852945.742963:0:7624:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.101@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1787852945.743003:0:7624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f49013fd200/0x710df789068e6079 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e6080 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852945.743021:0:7624:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: ffff8f49013fd200/0x710df789068e6079 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e6080 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787852945.743030:0:7624:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f493dc01800 from 1 10000000:01000000:3.0:1787852945.743034:0:7624:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787852945.743083:0:7624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f49029cd200/0x710df789068e6095 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852945.743092:0:7624:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.101@tcp lock: ffff8f49029cd200/0x710df789068e6095 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852945.743104:0:7624:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: ffff8f49029cd200/0x710df789068e6095 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787852945.743132:0:7624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f491419bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d48a955-7010-4118-9c7d-f396984ae1ff:7624:1874699552309376:0@lo:101: 00000100:00100000:3.0:1787852945.743224:0:7624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787852945.743277:0:7624:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f4904fb70c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787852945.746567:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552309376 00000100:00100000:0.0:1787852945.746597:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552309376 00000100:00100000:0.0:1787852945.746668:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787852945.746681:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4904f50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d48a955-7010-4118-9c7d-f396984ae1ff+12:7624:x1874699552309376:12345-0@lo:101: 00010000:00010000:0.0:1787852945.746700:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787852945.746721:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f4900031a00/0x710df789068e609c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x710df789068e6095 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852945.746770:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f4900031a00/0x710df789068e609c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x710df789068e6095 expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852945.746783:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f4900031a00/0x710df789068e609c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x710df789068e6095 expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852945.746792:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4900031a00, rc 0) 00000100:00100000:0.0:1787852945.747390:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4904f50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d48a955-7010-4118-9c7d-f396984ae1ff+13:7624:x1874699552309376:12345-0@lo:101: Request processed in 710us (4169us total) trans 0 rc 0/0 00000100:00100000:0.0:1787852945.747399:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787852945.747465:0:7624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f491419bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d48a955-7010-4118-9c7d-f396984ae1ff:7624:1874699552309376:0@lo:101: 00010000:00010000:3.0:1787852945.747497:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: ffff8f49029cd200/0x710df789068e6095 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e609c expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852945.747511:0:7624:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: ffff8f49029cd200/0x710df789068e6095 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x710df789068e609c expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787852945.747728:0:7624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f491419bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d48a955-7010-4118-9c7d-f396984ae1ff:7624:1874699552309504:0@lo:501: 00000100:00100000:3.0:1787852945.747772:0:7624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787852945.747815:0:7624:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f4904fb70c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787852945.747900:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552309504 00000100:00100000:2.0:1787852945.747905:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552309504 00000100:00100000:2.0:1787852945.747941:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787852945.747951:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4904f50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+13:7624:x1874699552309504:12345-0@lo:501: 00000100:00100000:2.0:1787852945.748250:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4904f50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+13:7624:x1874699552309504:12345-0@lo:501: Request processed in 300us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1787852945.748258:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787852945.748452:0:7624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f491419bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d48a955-7010-4118-9c7d-f396984ae1ff:7624:1874699552309504:0@lo:501: 00000100:00100000:0.0:1787852945.748493:0:7624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49079f12c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d48a955-7010-4118-9c7d-f396984ae1ff:7624:1874699552309632:0@lo:503: 00000100:00100000:0.0:1787852945.748531:0:7624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787852945.748560:0:7624:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f4911533d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787852945.748672:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552309632 00000100:00100000:3.0:1787852945.748676:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552309632 00000100:00100000:3.0:1787852945.748733:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787852945.748740:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4904f50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d48a955-7010-4118-9c7d-f396984ae1ff+13:7624:x1874699552309632:12345-0@lo:503: 00000100:00100000:3.0:1787852945.749088:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4904f50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d48a955-7010-4118-9c7d-f396984ae1ff+13:7624:x1874699552309632:12345-0@lo:503: Request processed in 348us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1787852945.749096:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787852945.749158:0:7624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49079f12c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d48a955-7010-4118-9c7d-f396984ae1ff:7624:1874699552309632:0@lo:503: 00000040:00080000:0.0:1787852945.749523:0:7624:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787852945.749605:0:7624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49079f12c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d48a955-7010-4118-9c7d-f396984ae1ff:7624:1874699552309760:0@lo:502: 00000100:00100000:0.0:1787852945.749638:0:7624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787852945.750792:0:7624:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f4906351000 going to sleep for 11 seconds 00000100:00100000:2.0:1787852945.750928:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552309760 00000100:00100000:2.0:1787852945.750937:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552309760 00000100:00100000:2.0:1787852945.751430:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787852945.751441:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4904f53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+13:7624:x1874699552309760:12345-0@lo:502: 00000100:00100000:2.0:1787852945.751790:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4904f53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+13:7624:x1874699552309760:12345-0@lo:502: Request processed in 351us (2150us total) trans 0 rc 0/0 00000100:00100000:2.0:1787852945.751798:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787852945.752058:0:7624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49079f12c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d48a955-7010-4118-9c7d-f396984ae1ff:7624:1874699552309760:0@lo:502: 00000040:00080000:0.0:1787852945.752382:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1787852945.752438:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1787852945.752475:0:7624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49079f12c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d48a955-7010-4118-9c7d-f396984ae1ff:7624:1874699552309888:0@lo:502: 00000100:00100000:0.0:1787852945.752523:0:7624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787852945.752559:0:7624:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f4911533d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787852945.752605:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552309888 00000100:00100000:0.0:1787852945.752611:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552309888 00000100:00100000:0.0:1787852945.752640:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787852945.752646:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4904f50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+13:7624:x1874699552309888:12345-0@lo:502: 00000100:00100000:0.0:1787852945.752797:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4904f50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+13:7624:x1874699552309888:12345-0@lo:502: Request processed in 150us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1787852945.752803:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787852945.752841:0:7624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49079f12c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d48a955-7010-4118-9c7d-f396984ae1ff:7624:1874699552309888:0@lo:502: 00000040:00080000:0.0:1787852945.752920:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1787852945.752928:0:7624:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1787852945.754155:0:7636:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787852945.754168:0:7636:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787852945.754172:0:7636:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787852945.754178:0:7636:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f493dc01800 00000020:00000080:1.0:1787852945.754182:0:7636:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787852945.754271:0:7636:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787852945.754275:0:7636:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787852945.754276:0:7636:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1787852945.754279:0:7636:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1787852945.755834:0:7624:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1787852945.755877:0:7624:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787852945.755975:0:7624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f49029cd200/0x710df789068e6095 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e609c expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852945.755989:0:7624:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: ffff8f49029cd200/0x710df789068e6095 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e609c expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787852945.756061:0:7624:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787852945.756064:0:7624:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8f493dc01800 10000000:01000000:0.0:1787852945.756068:0:7624:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8f493dc01800 10000000:01000000:0.0:1787852945.756073:0:7624:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787852945.756079:0:7624:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8f493dc01800 from 1 10000000:01000000:0.0:1787852945.756082:0:7624:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787852945.756123:0:7624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f4900031600/0x710df789068e60a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852945.756132:0:7624:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.101@tcp lock: ffff8f4900031600/0x710df789068e60a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852945.756145:0:7624:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: ffff8f4900031600/0x710df789068e60a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787852945.756173:0:7624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49079f12c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d48a955-7010-4118-9c7d-f396984ae1ff:7624:1874699552310016:0@lo:101: 00000100:00100000:0.0:1787852945.756250:0:7624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787852945.756439:0:7624:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f4911533d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787852945.756758:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552310016 00000100:00100000:1.0:1787852945.756767:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552310016 00000100:00100000:1.0:1787852945.756869:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787852945.756880:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4904f53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+13:7624:x1874699552310016:12345-0@lo:101: 00010000:00010000:1.0:1787852945.756899:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787852945.756917:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f49421e3800/0x710df789068e60aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x710df789068e60a3 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852945.756946:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f49421e3800/0x710df789068e60aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x710df789068e60a3 expref: 14 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852945.756959:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f49421e3800/0x710df789068e60aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x710df789068e60a3 expref: 14 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852945.756969:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49421e3800, rc 0) 00000100:00100000:0.0:1787852945.757113:0:7624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49079f12c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d48a955-7010-4118-9c7d-f396984ae1ff:7624:1874699552310016:0@lo:101: 00010000:00010000:0.0:1787852945.757127:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: ffff8f4900031600/0x710df789068e60a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e60aa expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852945.757135:0:7624:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: ffff8f4900031600/0x710df789068e60a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x710df789068e60aa expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787852945.757287:0:7624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49079f12c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d48a955-7010-4118-9c7d-f396984ae1ff:7624:1874699552310144:0@lo:501: 00000100:00100000:0.0:1787852945.757320:0:7624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787852945.757405:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4904f53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+14:7624:x1874699552310016:12345-0@lo:101: Request processed in 146us (773us total) trans 0 rc 0/0 00000100:00100000:1.0:1787852945.757422:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787852945.757494:0:7624:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f4911533d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787852945.757605:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552310144 00000100:00100000:1.0:1787852945.757610:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552310144 00000100:00100000:1.0:1787852945.757628:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787852945.757634:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4904f51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+14:7624:x1874699552310144:12345-0@lo:501: 00000100:00100000:1.0:1787852945.757888:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4904f51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+14:7624:x1874699552310144:12345-0@lo:501: Request processed in 252us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1787852945.757895:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787852945.757965:0:7624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49079f12c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d48a955-7010-4118-9c7d-f396984ae1ff:7624:1874699552310144:0@lo:501: 00000100:00100000:0.0:1787852945.757993:0:7624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49079f12c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d48a955-7010-4118-9c7d-f396984ae1ff:7624:1874699552310272:0@lo:503: 00000100:00100000:0.0:1787852945.758045:0:7624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787852945.758066:0:7624:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f4911533d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787852945.758107:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552310272 00000100:00100000:1.0:1787852945.758111:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552310272 00000100:00100000:1.0:1787852945.758127:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787852945.758131:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4904f52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+14:7624:x1874699552310272:12345-0@lo:503: 00000100:00100000:1.0:1787852945.758288:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4904f52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+14:7624:x1874699552310272:12345-0@lo:503: Request processed in 156us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1787852945.758295:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787852945.758438:0:7624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49079f12c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d48a955-7010-4118-9c7d-f396984ae1ff:7624:1874699552310272:0@lo:503: 00000040:00080000:0.0:1787852945.758808:0:7624:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787852945.758902:0:7624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49079f12c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d48a955-7010-4118-9c7d-f396984ae1ff:7624:1874699552310400:0@lo:502: 00000100:00100000:0.0:1787852945.758947:0:7624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787852945.758968:0:7624:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f4906351000 going to sleep for 11 seconds 00000100:00100000:1.0:1787852945.759147:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552310400 00000100:00100000:1.0:1787852945.759153:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552310400 00000100:00100000:1.0:1787852945.759180:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787852945.759186:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4904f51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+14:7624:x1874699552310400:12345-0@lo:502: 00000100:00100000:1.0:1787852945.759425:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4904f51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+14:7624:x1874699552310400:12345-0@lo:502: Request processed in 238us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1787852945.759432:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787852945.759618:0:7624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49079f12c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d48a955-7010-4118-9c7d-f396984ae1ff:7624:1874699552310400:0@lo:502: 00000040:00080000:0.0:1787852945.759929:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1787852945.759986:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1787852945.760048:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1787852945.760108:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1787852945.760146:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1787852945.760197:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1787852945.760231:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1787852945.760263:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1787852945.760310:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1787852945.760373:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1787852945.760407:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1787852945.760454:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1787852945.760490:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1787852945.760545:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1787852945.760636:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1787852945.760670:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1787852945.760700:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1787852945.760745:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1787852945.760780:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1787852945.760811:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1787852945.760874:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1787852945.760910:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1787852945.760943:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1787852945.760994:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1787852945.761031:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1787852945.761062:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1787852945.761110:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1787852945.761145:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:0.0:1787852945.761179:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1787852945.761260:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:0.0:1787852945.761294:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:0.0:1787852945.761321:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:0.0:1787852945.761367:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:0.0:1787852945.761413:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:0.0:1787852945.761447:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:0.0:1787852945.761490:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:0.0:1787852945.761525:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:0.0:1787852945.761617:0:7624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49079f12c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d48a955-7010-4118-9c7d-f396984ae1ff:7624:1874699552310528:0@lo:502: 00000100:00100000:0.0:1787852945.761707:0:7624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787852945.761766:0:7624:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f4911533d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787852945.762488:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552310528 00000100:00100000:1.0:1787852945.762496:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552310528 00000100:00100000:1.0:1787852945.762543:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787852945.762553:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4911c01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+14:7624:x1874699552310528:12345-0@lo:502: 00000100:00100000:1.0:1787852945.762850:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4911c01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+14:7624:x1874699552310528:12345-0@lo:502: Request processed in 298us (1142us total) trans 0 rc 0/0 00000100:00100000:1.0:1787852945.762859:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787852945.763064:0:7624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49079f12c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d48a955-7010-4118-9c7d-f396984ae1ff:7624:1874699552310528:0@lo:502: 00000040:00080000:0.0:1787852945.763166:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:0.0:1787852945.763183:0:7624:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:0.0:1787852945.764100:0:7637:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1787852945.764143:0:7637:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8f49415e0000) 00000020:00000080:0.0:1787852945.764177:0:7637:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:0.0:1787852945.764270:0:7637:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f493dc01800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787852945.764275:0:7637:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f493dc01800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787852945.764278:0:7637:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f493dc01800 3 00010000:00080000:0.0:1787852945.764315:0:7637:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f49415c8000@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.101@tcp at head 00010000:00010000:0.0:1787852945.768125:0:7637:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:0.0:1787852945.768524:0:7637:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1787852945.768604:0:7637:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787852945.768619:0:7637:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x710df789068e60b8 00000100:00080000:0.0:1787852945.768629:0:7637:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787852945.768635:0:7637:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8f49415c8000 using connection 192.168.204.101@tcp/0@lo 00000100:00100000:0.0:1787852945.768671:0:7637:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f49079f12c0 x1874699552310656/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787852945.768700:0:7637:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787852945.769078:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f491419bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874699552310912:0@lo:400: 00000100:00100000:3.0:1787852945.769162:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787852945.769201:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787852945.769208:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49141992c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874699552310784:0@lo:400: 00000100:00100000:3.0:1787852945.769235:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787852945.769266:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49216e7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1874699552311040:0@lo:400: 00000100:00100000:3.0:1787852945.769293:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787852945.769421:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552310912 00000100:00100000:3.0:1787852945.769431:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552310912 00000100:00100000:3.0:1787852945.769499:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787852945.769509:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49216e5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1874699552310912:12345-0@lo:400: 00000100:00100000:3.0:1787852945.769565:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49216e5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1874699552310912:12345-0@lo:400: Request processed in 58us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1787852945.769602:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787852945.769627:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552310784 00000100:00100000:3.0:1787852945.769644:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552310784 00000100:00100000:3.0:1787852945.769673:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552311040 00000100:00100000:3.0:1787852945.769677:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552311040 00000100:00100000:3.0:1787852945.769695:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787852945.769701:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49216e6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874699552310784:12345-0@lo:400: 00000100:00100000:3.0:1787852945.769733:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49216e6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874699552310784:12345-0@lo:400: Request processed in 32us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1787852945.769740:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787852945.769751:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787852945.769757:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49216e43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874699552311040:12345-0@lo:400: 00000100:00100000:3.0:1787852945.769790:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49216e43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874699552311040:12345-0@lo:400: Request processed in 33us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1787852945.769795:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1787852945.769816:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787852945.769821:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787852945.769858:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f49216e7c00 x1874699552311040/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787852961 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787852945.769872:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49216e7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1874699552311040:0@lo:400: 00010000:00080000:3.0:1787852945.769897:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f49141992c0 x1874699552310784/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787852961 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787852945.769906:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49141992c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874699552310784:0@lo:400: 00010000:00080000:3.0:1787852945.769914:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f491419bc00 x1874699552310912/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787852961 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787852945.769921:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f491419bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874699552310912:0@lo:400: 00000040:00080000:0.0:1787852945.770192:0:7637:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:1.0:1787852945.771453:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49079f12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1874699552310656:0@lo:38: 00000100:00100000:1.0:1787852945.771547:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:1.0:1787852945.771643:0:7624:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:1.0:1787852945.771680:0:7624:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787852945.771700:0:7624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f4900031600/0x710df789068e60a3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e60aa expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852945.771710:0:7624:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: ffff8f4900031600/0x710df789068e60a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e60aa expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787852945.771771:0:7624:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787852945.771774:0:7624:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787852945.771775:0:7624:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787852945.771776:0:7624:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787852945.771777:0:7624:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787852945.771778:0:7624:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787852945.771780:0:7624:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787852945.771781:0:7624:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787852945.771783:0:7624:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787852945.771784:0:7624:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787852945.771786:0:7624:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787852945.771789:0:7624:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:1.0:1787852945.771792:0:7624:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787852945.771793:0:7624:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787852945.771794:0:7624:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787852945.771795:0:7624:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787852945.771796:0:7624:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787852945.771798:0:7624:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787852945.771799:0:7624:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787852945.771800:0:7624:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787852945.771801:0:7624:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787852945.771807:0:7624:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787852945.771808:0:7624:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787852945.771832:0:7624:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1787852945.771846:0:7624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4921696580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d48a955-7010-4118-9c7d-f396984ae1ff:7624:1874699552311168:0@lo:253: 00000100:00100000:1.0:1787852945.771887:0:7624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787852945.771907:0:7624:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f49064fa540 going to sleep for 11 seconds 00000100:00100000:1.0:1787852945.771932:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552311168 00000100:00100000:1.0:1787852945.771940:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552311168 00000100:00100000:1.0:1787852945.771984:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787852945.771993:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4911c02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+14:7624:x1874699552311168:12345-0@lo:253: 00000100:00100000:0.0:1787852945.772135:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552310656 00000100:00100000:0.0:1787852945.772140:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552310656 00000100:00100000:0.0:1787852945.772166:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787852945.772171:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4921695e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3305:x1874699552310656:12345-0@lo:38: 00010000:00080000:0.0:1787852945.772193:0:5838:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 265 last 0 00000020:00000080:0.0:1787852945.772228:0:5838:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x710df789068e60bf 00000004:00100000:0.0:1787852945.772244:0:5838:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787852945.772279:0:5838:0:(import.c:65:import_set_state_nolock()) ffff8f49415ce000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787852945.772411:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4921695e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874699552310656:12345-0@lo:38: Request processed in 237us (863us total) trans 0 rc 0/0 00000100:00100000:0.0:1787852945.772418:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1787852945.772467:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f49079f12c0 x1874699552310656/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787852955 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787852945.772486:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787852945.772495:0:3305:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1787852945.772502:0:3305:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787852945.772508:0:3305:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787852945.772510:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8f49415c8000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787852945.772517:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49079f12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1874699552310656:0@lo:38: 00000100:00100000:3.0:1787852945.772879:0:7638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49216e7c00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7638:1874699552311296:0@lo:901: 00000100:00100000:3.0:1787852945.772939:0:7638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787852945.772969:0:7638:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f4904fb70c0 going to sleep for 11 seconds 20000000:01000000:1.0:1787852945.773147:0:5829:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1787852945.773164:0:5829:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1787852945.773550:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552311296 00000100:00100000:0.0:1787852945.773556:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552311296 00000100:00100000:0.0:1787852945.773617:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787852945.773625:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f491419bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7638:x1874699552311296:12345-0@lo:901: 00000100:00100000:0.0:1787852945.773979:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f491419bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7638:x1874699552311296:12345-0@lo:901: Request processed in 355us (1037us total) trans 0 rc 0/0 00000100:00100000:0.0:1787852945.773990:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1787852945.774133:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787852945.774164:0:7638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f49216e7c00 x1874699552311296/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1787852961 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787852945.774178:0:7638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49216e7c00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7638:1874699552311296:0@lo:901: 20000000:01000000:1.0:1787852945.809499:0:5829:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787852945.809523:0:5829:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1787852945.809597:0:5852:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787852945.809602:0:5852:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787852945.809629:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f49029cd600/0x710df789068e60c6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852945.809649:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f49421e3a00/0x710df789068e604f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x710df789068e6048 expref: 14 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852945.809663:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f49029cd600/0x710df789068e60c6 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852945.809707:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f49421e3a00/0x710df789068e604f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x710df789068e6048 expref: 14 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852945.809723:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f49421e3a00/0x710df789068e604f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x710df789068e6048 expref: 14 pid: 5830 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787852945.809737:0:5852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49141992c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5852:1874699552311424:0@lo:104: 00000100:00100000:3.0:1787852945.809806:0:5852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787852945.809854:0:5852:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f4904fb7300 going to sleep for 11 seconds 00000100:00100000:1.0:1787852945.810162:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552311424 00000100:00100000:1.0:1787852945.810170:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552311424 00000100:00100000:1.0:1787852945.810226:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787852945.810236:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49216e7c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5d48a955-7010-4118-9c7d-f396984ae1ff+3:5852:x1874699552311424:12345-0@lo:104: 00010000:00010000:1.0:1787852945.810247:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.101@tcp lock: ffff8f4900030c00/0x710df789068e6048 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x710df789068e604f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852945.810295:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787852945.810301:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49216e7c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5d48a955-7010-4118-9c7d-f396984ae1ff+3:5852:x1874699552311424:12345-0@lo:104: Request processed in 68us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1787852945.810307:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:3.0:1787852945.810379:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787852945.810386:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.101@tcp lock: ffff8f4900030c00/0x710df789068e6048 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x710df789068e604f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852945.810407:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4900030c00 already unused, calling callback (ffffffffc1b55c20) 10000000:00010000:3.0:1787852945.810411:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.101@tcp lock: ffff8f4900030c00/0x710df789068e6048 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x710df789068e604f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852945.810420:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.101@tcp lock: ffff8f4900030c00/0x710df789068e6048 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x710df789068e604f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787852945.810427:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.101@tcp lock: ffff8f4900030c00/0x710df789068e6048 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x710df789068e604f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787852945.810433:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787852945.810475:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.101@tcp lock: ffff8f4900030c00/0x710df789068e6048 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x710df789068e604f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852945.810482:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787852945.810500:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.101@tcp lock: ffff8f4900030c00/0x710df789068e6048 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x710df789068e604f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852945.810506:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.101@tcp lock: ffff8f4900030c00/0x710df789068e6048 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x710df789068e604f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852945.810522:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787852945.810523:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787852945.810525:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787852945.810536:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4920570780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5d48a955-7010-4118-9c7d-f396984ae1ff:3307:1874699552311552:0@lo:103: 00000100:00100000:3.0:1787852945.810602:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787852945.810639:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552311552 00000100:00100000:3.0:1787852945.810643:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552311552 00010000:00010000:3.0:1787852945.810664:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f49421e3a00/0x710df789068e604f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x710df789068e6048 expref: 15 pid: 5830 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787852945.810691:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787852945.810697:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f492eb75e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d48a955-7010-4118-9c7d-f396984ae1ff+15:3307:x1874699552311552:12345-0@lo:103: 00010000:00010000:3.0:1787852945.810708:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787852945.810712:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f49421e3a00/0x710df789068e604f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x710df789068e6048 expref: 15 pid: 5830 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852945.810723:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f49421e3a00/0x710df789068e604f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x710df789068e6048 expref: 15 pid: 5830 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852945.810740:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f49029cd600/0x710df789068e60c6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852945.810748:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f49029cd600/0x710df789068e60c6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787852945.810759:0:5822:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002505236s 00010000:00010000:3.0:1787852945.810763:0:5822:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f49029cd600/0x710df789068e60c6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852945.810769:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f49029cd600/0x710df789068e60c6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852945.810777:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f49029cd600/0x710df789068e60c6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852945.810784:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f49029cd600/0x710df789068e60c6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852945.810789:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49029cd600 already unused, calling callback (ffffffffc1528440) 00010000:00010000:3.0:1787852945.810793:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f49029cd600/0x710df789068e60c6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852945.810808:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f49029cd600/0x710df789068e60c6 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852945.810817:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f49029cd600/0x710df789068e60c6 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852945.810826:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787852945.810855:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f492eb75e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d48a955-7010-4118-9c7d-f396984ae1ff+15:3307:x1874699552311552:12345-0@lo:103: Request processed in 158us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1787852945.810861:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787852945.810893:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4920570780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5d48a955-7010-4118-9c7d-f396984ae1ff:3307:1874699552311552:0@lo:103: 00010000:00010000:3.0:1787852945.810919:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f49421e3a00/0x710df789068e604f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x710df789068e6048 expref: 14 pid: 5830 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787852945.810929:0:5852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49141992c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5852:1874699552311424:0@lo:104: 00010000:00010000:3.0:1787852945.810940:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f49029cd600/0x710df789068e60c6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852945.810950:0:5852:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f49029cd600/0x710df789068e60c6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852945.810956:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f49029cd600/0x710df789068e60c6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852945.810961:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f49029cd600/0x710df789068e60c6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787852945.819228:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4911c02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+13:7624:x1874699552311168:12345-0@lo:253: Request processed in 47223us (47328us total) trans 0 rc 0/0 00000100:00100000:1.0:1787852945.819246:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787852945.819422:0:7624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4921696580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d48a955-7010-4118-9c7d-f396984ae1ff:7624:1874699552311168:0@lo:253: 10000000:01000000:3.0:1787852945.819466:0:7624:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1787852945.819470:0:7624:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787852945.819472:0:7624:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787852945.819474:0:7624:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787852945.819476:0:7624:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787852945.819477:0:7624:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787852945.819479:0:7624:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787852945.819481:0:7624:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787852945.819483:0:7624:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787852945.819485:0:7624:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787852945.819488:0:7624:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787852945.819489:0:7624:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787852945.819507:0:7624:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1787852945.824258:0:7624:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1787852945.824464:0:7624:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1787852945.824869:0:7624:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1787852945.825381:0:7624:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1787852945.829112:0:7624:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1787852945.829770:0:7624:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1787852945.831507:0:7624:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1787852946.136011:0:7624:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1787852946.136043:0:7624:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1787852946.136100:0:7624:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787852946.136203:0:7624:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.101@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787852946.136228:0:7624:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1787852946.136272:0:7624:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:2.0:1787852946.220172:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787852947.246433:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787852947.689783:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787852947.689818:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f492eb76580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874699552311680:0@lo:13: 00000100:00100000:3.0:1787852947.689896:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787852947.689962:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552311680 00000100:00100000:3.0:1787852947.689969:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552311680 00000100:00100000:3.0:1787852947.690023:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787852947.690032:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f492eb76d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874699552311680:12345-0@lo:13: 00002000:00000024:3.0:1787852947.690082:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787852947.690124:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f492eb76d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874699552311680:12345-0@lo:13: Request processed in 93us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1787852947.690131:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1787852947.690158:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787852947.690187:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f492eb76580 x1874699552311680/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787852963 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787852947.690205:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f492eb76580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874699552311680:0@lo:13: 00010000:00010000:2.0:1787852948.273807:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787852949.295594:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787852950.314142:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787852951.278143:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49417430c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1874699552312192:0@lo:400: 00000100:00100000:2.0:1787852951.278276:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787852951.278283:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49417421c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5d48a955-7010-4118-9c7d-f396984ae1ff:3309:1874699552311808:0@lo:400: 00000100:00100000:3.0:1787852951.278339:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787852951.278367:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4941741680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1874699552312320:0@lo:400: 00000100:00100000:3.0:1787852951.278393:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787852951.278407:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49417403c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874699552312064:0@lo:400: 00000100:00100000:3.0:1787852951.278435:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552312192 00000100:00100000:3.0:1787852951.278447:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552312192 00000100:00100000:2.0:1787852951.278454:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787852951.278481:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787852951.278486:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4941743840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874699552311936:0@lo:400: 00000100:00100000:3.0:1787852951.278520:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552312320 00000100:00100000:3.0:1787852951.278524:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552312320 00000100:00100000:3.0:1787852951.278547:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787852951.278547:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787852951.278558:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49417412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874699552312192:12345-0@lo:400: 00000100:00100000:2.0:1787852951.278598:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552312064 00000100:00100000:2.0:1787852951.278601:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552312064 00000100:00100000:2.0:1787852951.278636:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787852951.278643:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4941741a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1874699552312064:12345-0@lo:400: 00000100:00100000:3.0:1787852951.278659:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49417412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874699552312192:12345-0@lo:400: Request processed in 103us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1787852951.278668:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787852951.278681:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4941741a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1874699552312064:12345-0@lo:400: Request processed in 39us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1787852951.278686:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787852951.278688:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552311936 00000100:00100000:3.0:1787852951.278690:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552311936 00000100:00100000:3.0:1787852951.278703:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787852951.278708:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f492eb77c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874699552312320:12345-0@lo:400: 00010000:00080000:2.0:1787852951.278726:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f49417403c0 x1874699552312064/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787852967 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787852951.278737:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f492eb77c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874699552312320:12345-0@lo:400: Request processed in 29us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1787852951.278742:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787852951.278744:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49417403c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874699552312064:0@lo:400: 00000100:00100000:3.0:1787852951.278752:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787852951.278757:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4941740f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874699552311936:12345-0@lo:400: 00000100:00080000:2.0:1787852951.279406:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787852951.279416:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787852951.279444:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552311808 00000100:00100000:2.0:1787852951.279452:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552311808 00000100:00100000:2.0:1787852951.279503:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787852951.279512:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4911c01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d48a955-7010-4118-9c7d-f396984ae1ff+13:3309:x1874699552311808:12345-0@lo:400: 00000100:00100000:2.0:1787852951.279668:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4911c01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d48a955-7010-4118-9c7d-f396984ae1ff+13:3309:x1874699552311808:12345-0@lo:400: Request processed in 157us (1328us total) trans 0 rc 0/0 00000100:00100000:2.0:1787852951.279676:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00010000:00080000:2.0:1787852951.279755:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f49417430c0 x1874699552312192/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787852967 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787852951.279769:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49417430c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1874699552312192:0@lo:400: 00000100:00100000:2.0:1787852951.279800:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49417421c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5d48a955-7010-4118-9c7d-f396984ae1ff:3309:1874699552311808:0@lo:400: 00010000:00080000:2.0:1787852951.279818:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f4941741680 x1874699552312320/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787852967 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787852951.279845:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4941741680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1874699552312320:0@lo:400: 00000100:00100000:3.0:1787852951.288554:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4941740f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874699552311936:12345-0@lo:400: Request processed in 9779us (10000us total) trans 0 rc 0/0 00000100:00100000:3.0:1787852951.288598:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1787852951.288689:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f4941743840 x1874699552311936/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787852967 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787852951.288711:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4941743840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874699552311936:0@lo:400: 00010000:00010000:1.0:1787852951.338277:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787852952.298379:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787852952.298392:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8f4903010800 from 30 10000000:01000000:3.0:1787852952.298399:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787852952.298467:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f49029cd600/0x710df789068e60cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852952.298483:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.101@tcp lock: ffff8f49029cd600/0x710df789068e60cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852952.298497:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: ffff8f49029cd600/0x710df789068e60cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787852952.298529:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f492eb74780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552312448:0@lo:101: 00000100:00100000:3.0:1787852952.298683:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787852952.298747:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f49063d4a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787852952.301408:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552312448 00000100:00100000:1.0:1787852952.301429:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552312448 00000100:00100000:1.0:1787852952.301508:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787852952.301520:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4911c03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+13:5834:x1874699552312448:12345-0@lo:101: 00010000:00010000:1.0:1787852952.301543:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787852952.301567:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f49421e2c00/0x710df789068e60d4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x710df789068e60cd expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852952.301623:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f49421e2c00/0x710df789068e60d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x710df789068e60cd expref: 14 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852952.301636:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f49421e2c00/0x710df789068e60d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x710df789068e60cd expref: 14 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852952.301648:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49421e2c00, rc 0) 00000100:00100000:1.0:1787852952.301748:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4911c03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+14:5834:x1874699552312448:12345-0@lo:101: Request processed in 230us (3066us total) trans 0 rc 0/0 00000100:00100000:1.0:1787852952.301755:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787852952.303046:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f492eb74780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552312448:0@lo:101: 00010000:00010000:3.0:1787852952.303077:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: ffff8f49029cd600/0x710df789068e60cd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e60d4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852952.303092:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: ffff8f49029cd600/0x710df789068e60cd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x710df789068e60d4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787852952.303205:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f492eb74780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552312576:0@lo:501: 00000100:00100000:3.0:1787852952.303391:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787852952.303446:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f49063d4a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787852952.303508:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552312576 00000100:00100000:1.0:1787852952.303517:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552312576 00000100:00100000:1.0:1787852952.303583:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787852952.303593:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4911c00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+14:5834:x1874699552312576:12345-0@lo:501: 00000100:00100000:1.0:1787852952.303937:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4911c00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+14:5834:x1874699552312576:12345-0@lo:501: Request processed in 345us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1787852952.303951:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787852952.306903:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f492eb74780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552312576:0@lo:501: 00000100:00100000:3.0:1787852952.306983:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f492eb74780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552312704:0@lo:503: 00000100:00100000:3.0:1787852952.307105:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787852952.307154:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f49063d4a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787852952.307176:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552312704 00000100:00100000:3.0:1787852952.307182:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552312704 00000100:00100000:3.0:1787852952.307248:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787852952.307259:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4911c00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d48a955-7010-4118-9c7d-f396984ae1ff+14:5834:x1874699552312704:12345-0@lo:503: 00000100:00100000:3.0:1787852952.307477:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4911c00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d48a955-7010-4118-9c7d-f396984ae1ff+14:5834:x1874699552312704:12345-0@lo:503: Request processed in 219us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1787852952.307484:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787852952.307644:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f492eb74780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552312704:0@lo:503: 00000100:00100000:3.0:1787852952.307892:0:7869:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f492eb74780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d48a955-7010-4118-9c7d-f396984ae1ff:7869:1874699552312832:0@lo:502: 00000100:00100000:3.0:1787852952.307926:0:7869:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787852952.307947:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552312832 00000100:00100000:3.0:1787852952.307950:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552312832 00000100:00100000:3.0:1787852952.307972:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787852952.307978:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4911c03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+14:7869:x1874699552312832:12345-0@lo:502: 00000100:00100000:3.0:1787852952.308142:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4911c03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+14:7869:x1874699552312832:12345-0@lo:502: Request processed in 164us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1787852952.308148:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787852952.308182:0:7869:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f49063d4a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787852952.308193:0:7869:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f492eb74780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d48a955-7010-4118-9c7d-f396984ae1ff:7869:1874699552312832:0@lo:502: 00000100:00100000:3.0:1787852952.308245:0:7869:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f492eb74780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d48a955-7010-4118-9c7d-f396984ae1ff:7869:1874699552312960:0@lo:502: 00000100:00100000:3.0:1787852952.308282:0:7869:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787852952.308299:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552312960 00000100:00100000:3.0:1787852952.308303:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552312960 00000100:00100000:3.0:1787852952.308321:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787852952.308332:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4911c00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+14:7869:x1874699552312960:12345-0@lo:502: 00000100:00100000:3.0:1787852952.308435:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4911c00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+14:7869:x1874699552312960:12345-0@lo:502: Request processed in 103us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1787852952.308442:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787852952.308466:0:7869:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f49063d4a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787852952.308476:0:7869:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f492eb74780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d48a955-7010-4118-9c7d-f396984ae1ff:7869:1874699552312960:0@lo:502: 00000040:00080000:3.0:1787852952.308494:0:7869:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1787852952.308553:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1787852952.308585:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787852952.308599:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f49029cd600/0x710df789068e60cd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e60d4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852952.308611:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: ffff8f49029cd600/0x710df789068e60cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e60d4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787852952.308621:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1787852952.308625:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:3.0:1787852952.308628:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1787852952.308655:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f49029cde00/0x710df789068e60db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852952.308662:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.101@tcp lock: ffff8f49029cde00/0x710df789068e60db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852952.308672:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: ffff8f49029cde00/0x710df789068e60db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787852952.308683:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f492eb74780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552313088:0@lo:101: 00000100:00100000:3.0:1787852952.308708:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787852952.308731:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f4908cb7600 going to sleep for 11 seconds 00000100:00100000:3.0:1787852952.308742:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552313088 00000100:00100000:3.0:1787852952.308745:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552313088 00000100:00100000:3.0:1787852952.308766:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787852952.308771:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4911c01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d48a955-7010-4118-9c7d-f396984ae1ff+14:5834:x1874699552313088:12345-0@lo:101: 00010000:00010000:3.0:1787852952.308781:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787852952.308796:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f49029cc400/0x710df789068e60e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x710df789068e60db expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852952.308818:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f49029cc400/0x710df789068e60e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x710df789068e60db expref: 15 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852952.308831:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f49029cc400/0x710df789068e60e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x710df789068e60db expref: 15 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852952.308840:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49029cc400, rc 0) 00000100:00100000:3.0:1787852952.308864:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4911c01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d48a955-7010-4118-9c7d-f396984ae1ff+15:5834:x1874699552313088:12345-0@lo:101: Request processed in 93us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1787852952.308870:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787852952.308896:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f492eb74780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552313088:0@lo:101: 00010000:00010000:3.0:1787852952.308909:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: ffff8f49029cde00/0x710df789068e60db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e60e2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852952.308918:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: ffff8f49029cde00/0x710df789068e60db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x710df789068e60e2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787852952.308959:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f492eb74780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552313216:0@lo:501: 00000100:00100000:3.0:1787852952.308983:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787852952.308994:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f4908cb7600 going to sleep for 11 seconds 00000100:00100000:3.0:1787852952.309010:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552313216 00000100:00100000:3.0:1787852952.309014:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552313216 00000100:00100000:3.0:1787852952.309034:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787852952.309040:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4911c02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+15:5834:x1874699552313216:12345-0@lo:501: 00000100:00100000:3.0:1787852952.309312:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4911c02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+15:5834:x1874699552313216:12345-0@lo:501: Request processed in 272us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1787852952.309321:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787852952.309349:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f492eb74780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552313216:0@lo:501: 00000100:00100000:3.0:1787852952.309374:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f492eb74780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552313344:0@lo:503: 00000100:00100000:3.0:1787852952.309409:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787852952.309422:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f4908cb7600 going to sleep for 11 seconds 00000100:00100000:3.0:1787852952.309432:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552313344 00000100:00100000:3.0:1787852952.309436:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552313344 00000100:00100000:3.0:1787852952.309454:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787852952.309460:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4911c03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+15:5834:x1874699552313344:12345-0@lo:503: 00000100:00100000:3.0:1787852952.312965:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4911c03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+15:5834:x1874699552313344:12345-0@lo:503: Request processed in 3490us (3541us total) trans 0 rc 0/0 00000100:00100000:3.0:1787852952.312983:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787852952.313313:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f492eb74780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552313344:0@lo:503: 00000100:00100000:2.0:1787852952.313611:0:7870:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4941743840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d48a955-7010-4118-9c7d-f396984ae1ff:7870:1874699552313472:0@lo:502: 00000100:00100000:2.0:1787852952.314895:0:7870:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787852952.315035:0:7870:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f494131bf00 going to sleep for 11 seconds 00000100:00100000:1.0:1787852952.325037:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552313472 00000100:00100000:1.0:1787852952.325055:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552313472 00000100:00100000:2.0:1787852952.326074:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787852952.326089:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4911c00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d48a955-7010-4118-9c7d-f396984ae1ff+15:7870:x1874699552313472:12345-0@lo:502: 00000100:00100000:2.0:1787852952.326536:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4911c00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d48a955-7010-4118-9c7d-f396984ae1ff+15:7870:x1874699552313472:12345-0@lo:502: Request processed in 449us (11648us total) trans 0 rc 0/0 00000100:00100000:2.0:1787852952.326545:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787852952.326554:0:7870:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4941743840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d48a955-7010-4118-9c7d-f396984ae1ff:7870:1874699552313472:0@lo:502: 00000020:01000000:0.0:1787852952.326619:0:7870:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787852952.326631:0:7870:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787852952.326634:0:7870:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787852952.326641:0:7870:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787852952.326643:0:7870:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1787852952.326685:0:7870:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49079f0f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d48a955-7010-4118-9c7d-f396984ae1ff:7870:1874699552313600:0@lo:502: 00000100:00100000:0.0:1787852952.326743:0:7870:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787852952.326792:0:7870:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f492eb6ccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787852952.326814:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552313600 00000100:00100000:0.0:1787852952.326974:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552313600 00000100:00100000:0.0:1787852952.327023:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787852952.327031:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4911c03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+15:7870:x1874699552313600:12345-0@lo:502: 00000100:00100000:0.0:1787852952.327412:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4911c03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+15:7870:x1874699552313600:12345-0@lo:502: Request processed in 380us (668us total) trans 0 rc 0/0 00000100:00100000:0.0:1787852952.327420:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787852952.327470:0:7870:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49079f0f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d48a955-7010-4118-9c7d-f396984ae1ff:7870:1874699552313600:0@lo:502: 00000020:01000000:0.0:1787852952.327494:0:7870:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787852952.327500:0:7870:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787852952.327502:0:7870:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787852952.327506:0:7870:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:2.0:1787852952.327695:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:2.0:1787852952.327723:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.101@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1787852952.327737:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f49029cde00/0x710df789068e60db lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e60e2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787852952.327749:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: ffff8f49029cde00/0x710df789068e60db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e60e2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787852952.327762:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787852952.327765:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8f492abd6000 from 30 10000000:01000000:2.0:1787852952.327769:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787852952.327803:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f49013fc000/0x710df789068e60e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787852952.327817:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.101@tcp lock: ffff8f49013fc000/0x710df789068e60e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787852952.327829:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: ffff8f49013fc000/0x710df789068e60e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787852952.327849:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4941741680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552313728:0@lo:101: 00000100:00100000:2.0:1787852952.327886:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787852952.327910:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f494131be40 going to sleep for 11 seconds 00000100:00100000:2.0:1787852952.328029:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552313728 00000100:00100000:2.0:1787852952.328035:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552313728 00000100:00100000:2.0:1787852952.328070:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787852952.328077:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4911c02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+15:5834:x1874699552313728:12345-0@lo:101: 00010000:00010000:2.0:1787852952.328089:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787852952.328108:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f49013fdc00/0x710df789068e60f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x710df789068e60e9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787852952.328138:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f49013fdc00/0x710df789068e60f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x710df789068e60e9 expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787852952.328151:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f49013fdc00/0x710df789068e60f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x710df789068e60e9 expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787852952.328162:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49013fdc00, rc 0) 00000100:00100000:2.0:1787852952.328196:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4911c02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+16:5834:x1874699552313728:12345-0@lo:101: Request processed in 119us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1787852952.328202:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787852952.328252:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4941741680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552313728:0@lo:101: 00010000:00010000:2.0:1787852952.328272:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: ffff8f49013fc000/0x710df789068e60e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e60f0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787852952.328282:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: ffff8f49013fc000/0x710df789068e60e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x710df789068e60f0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787852952.328335:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4941741680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552313856:0@lo:501: 00000100:00100000:2.0:1787852952.328361:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787852952.328385:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f494131be40 going to sleep for 11 seconds 00000100:00100000:2.0:1787852952.328398:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552313856 00000100:00100000:2.0:1787852952.328402:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552313856 00000100:00100000:2.0:1787852952.328421:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787852952.328428:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4911c01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+16:5834:x1874699552313856:12345-0@lo:501: 00000100:00100000:2.0:1787852952.328735:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4911c01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+16:5834:x1874699552313856:12345-0@lo:501: Request processed in 306us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1787852952.328742:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787852952.328773:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4941741680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552313856:0@lo:501: 00000100:00100000:2.0:1787852952.328798:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4941741680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552313984:0@lo:503: 00000100:00100000:2.0:1787852952.328839:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787852952.328854:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f494131be40 going to sleep for 11 seconds 00000100:00100000:2.0:1787852952.328864:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552313984 00000100:00100000:2.0:1787852952.328868:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552313984 00000100:00100000:2.0:1787852952.328886:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787852952.328892:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4907f78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+16:5834:x1874699552313984:12345-0@lo:503: 00000100:00100000:2.0:1787852952.329051:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4907f78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+16:5834:x1874699552313984:12345-0@lo:503: Request processed in 158us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1787852952.329057:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787852952.329099:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4941741680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552313984:0@lo:503: 00000100:00100000:0.0:1787852952.332070:0:7871:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49079f0f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d48a955-7010-4118-9c7d-f396984ae1ff:7871:1874699552314112:0@lo:502: 00000100:00100000:0.0:1787852952.332233:0:7871:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787852952.332306:0:7871:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f492eb6ca80 going to sleep for 11 seconds 00000100:00100000:2.0:1787852952.332799:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552314112 00000100:00100000:2.0:1787852952.332809:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552314112 00000100:00100000:2.0:1787852952.332911:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787852952.332923:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4906231450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+16:7871:x1874699552314112:12345-0@lo:502: 00000100:00100000:2.0:1787852952.333278:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4906231450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+16:7871:x1874699552314112:12345-0@lo:502: Request processed in 356us (1046us total) trans 0 rc 0/0 00000100:00100000:2.0:1787852952.333288:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787852952.334074:0:7871:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49079f0f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d48a955-7010-4118-9c7d-f396984ae1ff:7871:1874699552314112:0@lo:502: 00000100:00100000:1.0:1787852952.336831:0:7871:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49079f0f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d48a955-7010-4118-9c7d-f396984ae1ff:7871:1874699552314240:0@lo:502: 00000100:00100000:1.0:1787852952.336966:0:7871:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787852952.337020:0:7871:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f491e9820c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787852952.337450:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552314240 00000100:00100000:2.0:1787852952.337462:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552314240 00000100:00100000:2.0:1787852952.337541:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787852952.337553:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4906231050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+16:7871:x1874699552314240:12345-0@lo:502: 00000100:00100000:2.0:1787852952.338093:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4906231050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+16:7871:x1874699552314240:12345-0@lo:502: Request processed in 537us (1123us total) trans 0 rc 0/0 00000100:00100000:2.0:1787852952.338102:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787852952.338227:0:7871:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49079f0f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d48a955-7010-4118-9c7d-f396984ae1ff:7871:1874699552314240:0@lo:502: 00000040:00080000:1.0:1787852952.338276:0:7871:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1787852952.338488:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1787852952.338513:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787852952.338526:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f49013fc000/0x710df789068e60e9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e60f0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787852952.338539:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: ffff8f49013fc000/0x710df789068e60e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e60f0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787852952.338549:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787852952.338552:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8f492abd6000 from 5 10000000:01000000:2.0:1787852952.338556:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787852952.338944:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f49013fc800/0x710df789068e60f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787852952.338966:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.101@tcp lock: ffff8f49013fc800/0x710df789068e60f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787852952.338979:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: ffff8f49013fc800/0x710df789068e60f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787852952.339005:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4941741680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552314368:0@lo:101: 00000100:00100000:2.0:1787852952.339060:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787852952.339146:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f494131ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1787852952.343768:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552314368 00000100:00100000:1.0:1787852952.343796:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552314368 00000100:00100000:1.0:1787852952.343884:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787852952.343900:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4906230850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+16:5834:x1874699552314368:12345-0@lo:101: 00010000:00010000:1.0:1787852952.343926:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787852952.343958:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f49421e2e00/0x710df789068e60fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x710df789068e60f7 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852952.343997:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f49421e2e00/0x710df789068e60fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x710df789068e60f7 expref: 17 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852952.344009:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f49421e2e00/0x710df789068e60fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x710df789068e60f7 expref: 17 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852952.344021:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49421e2e00, rc 0) 00000100:00100000:1.0:1787852952.344129:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4906230850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+17:5834:x1874699552314368:12345-0@lo:101: Request processed in 234us (5068us total) trans 0 rc 0/0 00000100:00100000:1.0:1787852952.344137:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787852952.344226:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4941741680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552314368:0@lo:101: 00010000:00010000:1.0:1787852952.344262:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: ffff8f49013fc800/0x710df789068e60f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e60fe expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852952.344273:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: ffff8f49013fc800/0x710df789068e60f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x710df789068e60fe expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787852952.344359:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4921694f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552314496:0@lo:256: 00000100:00100000:1.0:1787852952.344406:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787852952.344445:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f491e982a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787852952.344462:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552314496 00000100:00100000:1.0:1787852952.344467:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552314496 00000100:00100000:1.0:1787852952.344494:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787852952.344501:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4906232c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+17:5834:x1874699552314496:12345-0@lo:256: 20000000:01000000:1.0:1787852952.344520:0:5829:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787852952.344542:0:5829:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787852952.344545:0:5829:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1787852952.345244:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4906232c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+17:5834:x1874699552314496:12345-0@lo:256: Request processed in 737us (832us total) trans 0 rc 0/0 00000100:00100000:1.0:1787852952.345255:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787852952.345314:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4921694f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552314496:0@lo:256: 10000000:01000000:1.0:1787852952.345377:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787852952.345390:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f49013fc800/0x710df789068e60f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e60fe expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852952.345402:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: ffff8f49013fc800/0x710df789068e60f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e60fe expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787852952.345415:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1787852952.345426:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:1.0:1787852952.345429:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787852952.345461:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f49421e2800/0x710df789068e6105 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852952.345469:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.101@tcp lock: ffff8f49421e2800/0x710df789068e6105 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852952.345480:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: ffff8f49421e2800/0x710df789068e6105 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787852952.345496:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4921694f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552314624:0@lo:101: 00000100:00100000:1.0:1787852952.345523:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787852952.345563:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f491e982a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787852952.345604:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552314624 00000100:00100000:1.0:1787852952.345610:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552314624 00000100:00100000:1.0:1787852952.345647:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787852952.345655:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4906233c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+17:5834:x1874699552314624:12345-0@lo:101: 00010000:00010000:1.0:1787852952.345666:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787852952.345682:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f49421e3a00/0x710df789068e610c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x710df789068e6105 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852952.345703:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f49421e3a00/0x710df789068e610c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x710df789068e6105 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852952.345714:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f49421e3a00/0x710df789068e610c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x710df789068e6105 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852952.345724:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49421e3a00, rc 0) 00000100:00100000:1.0:1787852952.345756:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4906233c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+18:5834:x1874699552314624:12345-0@lo:101: Request processed in 102us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1787852952.345769:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787852952.345801:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4921694f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552314624:0@lo:101: 00010000:00010000:1.0:1787852952.345814:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: ffff8f49421e2800/0x710df789068e6105 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e610c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852952.345825:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: ffff8f49421e2800/0x710df789068e6105 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x710df789068e610c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787852952.345888:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4921694f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552314752:0@lo:501: 00000100:00100000:1.0:1787852952.345917:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787852952.345932:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f491e982a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787852952.345943:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552314752 00000100:00100000:1.0:1787852952.345946:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552314752 00000100:00100000:1.0:1787852952.345965:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787852952.345971:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4906231c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+18:5834:x1874699552314752:12345-0@lo:501: 00000100:00100000:1.0:1787852952.346322:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4906231c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+18:5834:x1874699552314752:12345-0@lo:501: Request processed in 349us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1787852952.346330:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787852952.346360:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4921694f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552314752:0@lo:501: 00000100:00100000:1.0:1787852952.346390:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4921694f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552314880:0@lo:503: 00000100:00100000:1.0:1787852952.346433:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787852952.346446:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f491e982a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787852952.346458:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552314880 00000100:00100000:1.0:1787852952.346461:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552314880 00000100:00100000:1.0:1787852952.346478:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787852952.346485:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4911c02850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+18:5834:x1874699552314880:12345-0@lo:503: 00000100:00100000:1.0:1787852952.346745:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4911c02850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+18:5834:x1874699552314880:12345-0@lo:503: Request processed in 260us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1787852952.346751:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787852952.346793:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4921694f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552314880:0@lo:503: 00000100:00100000:2.0:1787852952.358059:0:7876:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49417421c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d48a955-7010-4118-9c7d-f396984ae1ff:7876:1874699552315008:0@lo:502: 00000100:00100000:2.0:1787852952.358187:0:7876:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787852952.358268:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552315008 00000100:00100000:2.0:1787852952.358276:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552315008 00000100:00100000:2.0:1787852952.358331:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787852952.358342:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4906232050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+18:7876:x1874699552315008:12345-0@lo:502: 00000100:00100000:2.0:1787852952.361109:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4906232050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+18:7876:x1874699552315008:12345-0@lo:502: Request processed in 2754us (2910us total) trans 0 rc 0/0 00000100:00100000:2.0:1787852952.361127:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787852952.361250:0:7876:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f494131be40 going to sleep for 11 seconds 00000100:00100000:2.0:1787852952.361286:0:7876:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49417421c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d48a955-7010-4118-9c7d-f396984ae1ff:7876:1874699552315008:0@lo:502: 00000020:01000000:2.0:1787852952.361332:0:7876:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787852952.361344:0:7876:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1787852952.361353:0:7876:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787852952.361356:0:7876:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1787852952.361362:0:7876:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787852952.361366:0:7876:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.101@tcp to nid 0x20000c0a8cc65 (192.168.204.101@tcp) 00000020:01000000:2.0:1787852952.361395:0:7876:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1787852952.361408:0:7876:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787852952.361429:0:7876:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8f493ffe33a0) 00000020:00000080:2.0:1787852952.361460:0:7876:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:2.0:1787852952.361464:0:7876:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787852952.361596:0:7876:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1787852952.361602:0:7876:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:2.0:1787852952.361615:0:7876:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x710df789068e611a 00010000:00080000:2.0:1787852952.362885:0:7876:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f4908ed1000@lustre-OST0001-osc-MDT0000: add connection 192.168.204.101@tcp at head 00010000:00010000:2.0:1787852952.363186:0:7876:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:2.0:1787852952.363693:0:7876:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1787852952.363712:0:7876:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1787852952.364900:0:7876:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787852952.365134:0:7876:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787852952.365198:0:7876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1787852952.365282:0:7876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00010000:00010000:2.0:1787852952.365816:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787852952.370977:0:7878:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787852952.370986:0:7878:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1787852952.372988:0:7876:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787852952.373009:0:7876:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787852952.373068:0:7876:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1787852952.373107:0:7876:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x710df789068e6121 00000100:00080000:2.0:1787852952.373125:0:7876:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787852952.373134:0:7876:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8f4908ed1000 using connection 192.168.204.101@tcp/0@lo 00000100:00100000:2.0:1787852952.373210:0:7876:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f49417421c0 x1874699552315136/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787852952.373255:0:7876:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1787852952.373331:0:7876:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787852952.373336:0:7876:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787852952.373338:0:7876:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1787852952.373342:0:7876:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787852952.373348:0:7876:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787852952.373350:0:7876:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787852952.373361:0:7876:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787852952.373364:0:7876:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1787852952.373401:0:7876:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49417430c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d48a955-7010-4118-9c7d-f396984ae1ff:7876:1874699552315264:0@lo:502: 00000100:00100000:3.0:1787852952.373447:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f492eb752c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874699552315392:0@lo:400: 00000100:00100000:1.0:1787852952.373584:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49417421c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1874699552315136:0@lo:8: 00000100:00100000:3.0:1787852952.385998:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787852952.386107:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787852952.386128:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f492eb74f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552315520:0@lo:400: 00000100:00100000:3.0:1787852952.386208:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787852952.386290:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f492eb75a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1874699552315648:0@lo:400: 00000100:00100000:3.0:1787852952.386332:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787852952.386358:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787852952.386367:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f492eb74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1874699552315776:0@lo:400: 00000100:00100000:3.0:1787852952.386389:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787852952.386427:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552315392 00000100:00100000:3.0:1787852952.386436:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552315392 00000100:00100000:3.0:1787852952.386496:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552315648 00000100:00100000:3.0:1787852952.386499:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552315648 00000100:00100000:3.0:1787852952.386516:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552315776 00000100:00100000:3.0:1787852952.386518:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552315776 00000100:00100000:3.0:1787852952.386534:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787852952.386545:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f492eb74b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874699552315392:12345-0@lo:400: 00000100:00100000:3.0:1787852952.386648:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f492eb74b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874699552315392:12345-0@lo:400: Request processed in 103us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1787852952.386657:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787852952.386680:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787852952.386687:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f492eb77840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874699552315648:12345-0@lo:400: 00000100:00100000:3.0:1787852952.386721:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f492eb77840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874699552315648:12345-0@lo:400: Request processed in 34us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1787852952.386728:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787852952.386742:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787852952.386748:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f492eb743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874699552315776:12345-0@lo:400: 00000100:00100000:3.0:1787852952.386778:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f492eb743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874699552315776:12345-0@lo:400: Request processed in 30us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1787852952.386785:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787852952.386805:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552315520 00000100:00100000:3.0:1787852952.386808:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552315520 00000100:00100000:2.0:1787852952.393018:0:7876:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787852952.393132:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787852952.393171:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f492eb761c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874699552315520:12345-0@lo:400: 00000100:00100000:3.0:1787852952.393304:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f492eb761c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874699552315520:12345-0@lo:400: Request processed in 143us (7095us total) trans 0 rc 0/0 00000100:00100000:3.0:1787852952.393313:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787852952.393355:0:7876:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f490316b840 going to sleep for 11 seconds 00000100:00100000:3.0:1787852952.393357:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552315264 00000100:00100000:3.0:1787852952.393367:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552315264 00000100:00100000:3.0:1787852952.393398:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787852952.393405:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4906232850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+18:7876:x1874699552315264:12345-0@lo:502: 00000100:00100000:1.0:1787852952.393540:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787852952.393671:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552315136 00000100:00100000:2.0:1787852952.393676:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552315136 00000100:00100000:2.0:1787852952.393699:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787852952.393704:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4921694f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3305:x1874699552315136:12345-0@lo:8: 00010000:00080000:2.0:1787852952.393736:0:6681:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 271 last 0 00000100:00100000:3.0:1787852952.393761:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4906232850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+18:7876:x1874699552315264:12345-0@lo:502: Request processed in 356us (759us total) trans 0 rc 0/0 00000100:00100000:3.0:1787852952.393768:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000020:00000080:2.0:1787852952.393778:0:6681:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x710df789068e6128 00002000:00100000:2.0:1787852952.393798:0:6681:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8f4941583800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113954 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1787852952.393803:0:6681:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:2.0:1787852952.393808:0:6681:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00010000:00080000:3.0:1787852952.393851:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f492eb74000 x1874699552315776/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787852968 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787852952.393868:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f492eb74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1874699552315776:0@lo:400: 00010000:00080000:3.0:1787852952.393886:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f492eb75a40 x1874699552315648/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787852968 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787852952.393895:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f492eb75a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1874699552315648:0@lo:400: 00010000:00080000:3.0:1787852952.393935:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f492eb74f00 x1874699552315520/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787852968 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787852952.393945:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f492eb74f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552315520:0@lo:400: 00010000:00080000:3.0:1787852952.393960:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f492eb752c0 x1874699552315392/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787852968 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787852952.393967:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f492eb752c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874699552315392:0@lo:400: 00002000:00100000:2.0:1787852952.394057:0:6681:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:1.0:1787852952.394262:0:7876:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49417430c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d48a955-7010-4118-9c7d-f396984ae1ff:7876:1874699552315264:0@lo:502: 00000020:01000000:1.0:1787852952.394298:0:7876:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787852952.394307:0:7876:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787852952.394310:0:7876:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787852952.394315:0:7876:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:1.0:1787852952.394396:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:1.0:1787852952.394417:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.101@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787852952.394430:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f49421e2800/0x710df789068e6105 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e610c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852952.394443:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: ffff8f49421e2800/0x710df789068e6105 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e610c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787852952.394456:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1787852952.394459:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8f490300cd70 from 1 10000000:01000000:1.0:1787852952.394463:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787852952.394498:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f49421e2200/0x710df789068e612f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852952.394506:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.101@tcp lock: ffff8f49421e2200/0x710df789068e612f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852952.394529:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: ffff8f49421e2200/0x710df789068e612f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787852952.394553:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49216952c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552315904:0@lo:101: 00000100:00100000:1.0:1787852952.394631:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787852952.394658:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f491e982a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787852952.394675:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552315904 00000100:00100000:1.0:1787852952.394679:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552315904 00000100:00100000:1.0:1787852952.394714:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787852952.394722:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4906233450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d48a955-7010-4118-9c7d-f396984ae1ff+18:5834:x1874699552315904:12345-0@lo:101: 00010000:00010000:1.0:1787852952.394735:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787852952.394751:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f49421e3600/0x710df789068e6136 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x710df789068e612f expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852952.394777:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f49421e3600/0x710df789068e6136 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x710df789068e612f expref: 19 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852952.394789:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f49421e3600/0x710df789068e6136 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x710df789068e612f expref: 19 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852952.394799:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49421e3600, rc 0) 00002000:00080000:2.0:1787852952.395448:0:6681:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787852952.395496:0:6681:0:(import.c:65:import_set_state_nolock()) ffff8f4941585800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787852952.395593:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4921694f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1874699552315136:12345-0@lo:8: Request processed in 1886us (2052us total) trans 0 rc 0/0 00000100:00100000:2.0:1787852952.395603:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1787852952.395673:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f49417421c0 x1874699552315136/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787852962 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787852952.395685:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787852952.395695:0:3305:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1787852952.395705:0:3305:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787852952.395711:0:3305:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1787852952.395714:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8f4908ed1000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787852952.395740:0:3305:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787852952.395747:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49417421c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1874699552315136:0@lo:8: 00000100:00100000:1.0:1787852952.395957:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4906233450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d48a955-7010-4118-9c7d-f396984ae1ff+19:5834:x1874699552315904:12345-0@lo:101: Request processed in 1234us (1325us total) trans 0 rc 0/0 00000100:00100000:1.0:1787852952.395965:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787852952.396015:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49216952c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552315904:0@lo:101: 00010000:00010000:1.0:1787852952.396039:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: ffff8f49421e2200/0x710df789068e612f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e6136 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852952.396061:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: ffff8f49421e2200/0x710df789068e612f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x710df789068e6136 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787852952.396132:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49216952c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552316032:0@lo:501: 00000004:00080000:3.0:1787852952.396345:0:7878:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787852952.396524:0:7878:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 271937953185ns, next at 0ns, rc = 0 00000100:00100000:1.0:1787852952.398005:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787852952.398069:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f491e982a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787852952.399750:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552316032 00000100:00100000:3.0:1787852952.399769:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552316032 00000100:00100000:3.0:1787852952.399840:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787852952.399851:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4906232450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+19:5834:x1874699552316032:12345-0@lo:501: 00000100:00100000:3.0:1787852952.400158:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4906232450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+19:5834:x1874699552316032:12345-0@lo:501: Request processed in 308us (2159us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787852952.400168:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787852952.404103:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49216952c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552316032:0@lo:501: 10000000:01000000:1.0:1787852952.405431:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.101@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787852952.405452:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f49421e2200/0x710df789068e612f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e6136 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852952.405467:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: ffff8f49421e2200/0x710df789068e612f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e6136 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787852952.532524:0:5858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:3.0:1787852952.535952:0:7879:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:3.0:1787852952.536000:0:7879:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f492eb74f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7879:1874699552316288:0@lo:7: 00000100:00100000:3.0:1787852952.536100:0:7879:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787852952.536163:0:7879:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f49101b8cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787852952.536450:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f492eb752c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552316160:0@lo:13: 00000100:00100000:2.0:1787852952.536491:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787852952.537666:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552316288 00000100:00100000:2.0:1787852952.537682:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552316288 00000100:00100000:2.0:1787852952.537772:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787852952.537783:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f492eb75a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7879:x1874699552316288:12345-0@lo:7: 00000100:00100000:3.0:1787852952.542027:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552316160 00000100:00100000:3.0:1787852952.542045:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552316160 00000100:00100000:3.0:1787852952.542114:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787852952.542126:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49417421c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1874699552316160:12345-0@lo:13: 00002000:00000024:3.0:1787852952.542182:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:3.0:1787852952.542309:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49417421c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1874699552316160:12345-0@lo:13: Request processed in 185us (5816us total) trans 0 rc 0/0 00000100:00100000:3.0:1787852952.542317:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1787852952.542382:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f492eb752c0 x1874699552316160/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787852968 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787852952.542406:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f492eb752c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552316160:0@lo:13: 00000100:00080000:3.0:1787852952.546190:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:2.0:1787852952.553689:0:6682:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:2.0:1787852952.553706:0:6682:0:(ofd_dev.c:1211:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:2.0:1787852952.554045:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f492eb75a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7879:x1874699552316288:12345-0@lo:7: Request processed in 16257us (17938us total) trans 0 rc 0/0 00000100:00100000:2.0:1787852952.554060:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1787852952.557670:0:7879:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f492eb74f00 x1874699552316288/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787852968 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787852952.557693:0:7879:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f492eb74f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7879:1874699552316288:0@lo:7: 00000004:00080000:3.0:1787852952.557719:0:7879:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:3.0:1787852952.557771:0:7879:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f492eb74f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7879:1874699552316416:0@lo:5: 00000100:00100000:3.0:1787852952.557859:0:7879:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787852952.557914:0:7879:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f49101b8cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787852952.558046:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552316416 00000100:00100000:1.0:1787852952.558055:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552316416 00000100:00100000:1.0:1787852952.558150:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787852952.558163:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f492eb752c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7879:x1874699552316416:12345-0@lo:5: 00002000:00080000:1.0:1787852952.558200:0:6684:0:(ofd_dev.c:1643:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1787852952.558205:0:6684:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1787852952.562683:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f492eb752c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:7879:x1874699552316416:12345-0@lo:5: Request processed in 4509us (4811us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1787852952.562700:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1787852952.568047:0:7879:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f492eb74f00 x1874699552316416/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787852968 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787852952.568077:0:7879:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f492eb74f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7879:1874699552316416:0@lo:5: 00000004:00080000:0.0:1787852952.568099:0:7879:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1787852952.568164:0:7879:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49079f1a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7879:1874699552316544:0@lo:700: 00000100:00100000:0.0:1787852952.568261:0:7879:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787852952.568330:0:7879:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f492eb6c600 going to sleep for 11 seconds 00000100:00100000:0.0:1787852952.568366:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552316544 00000100:00100000:0.0:1787852952.568375:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552316544 00000100:00100000:0.0:1787852952.568451:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787852952.568463:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49079f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7879:x1874699552316544:12345-0@lo:700: 00000100:00100000:0.0:1787852952.568511:0:6690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49079f0b40 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6690:1874699552316672:0@lo:700: 00000100:00100000:0.0:1787852952.568562:0:6690:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787852952.568609:0:6690:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f492eb6cc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787852952.568626:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552316672 00000100:00100000:0.0:1787852952.568629:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552316672 00000100:00100000:0.0:1787852952.568662:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787852952.568670:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49079f21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6690:x1874699552316672:12345-0@lo:700: 40000000:02000000:0.0:1787852952.658541:0:5843:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:0.0:1787852952.670741:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49079f21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6690:x1874699552316672:12345-0@lo:700: Request processed in 102058us (102164us total) trans 0 rc 0/0 00000100:00100000:0.0:1787852952.670760:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787852952.671134:0:6690:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f49079f0b40 x1874699552316672/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787852968 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787852952.671154:0:6690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49079f0b40 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6690:1874699552316672:0@lo:700: 40000000:02000000:0.0:1787852952.671176:0:6690:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000100:00100000:1.0:1787852952.814194:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787852952.814244:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49079f0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552316800:0@lo:13: 00000100:00100000:1.0:1787852952.814368:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787852952.814612:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552316800 00000100:00100000:0.0:1787852952.814626:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552316800 00000100:00100000:0.0:1787852952.814705:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787852952.814718:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49216952c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874699552316800:12345-0@lo:13: 00002000:00000024:0.0:1787852952.814791:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787852952.814877:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49216952c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874699552316800:12345-0@lo:13: Request processed in 162us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1787852952.814886:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1787852952.814942:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f49079f0b40 x1874699552316800/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787852968 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787852952.814965:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49079f0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552316800:0@lo:13: 00000100:00100000:0.0:1787852952.833447:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49079f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7879:x1874699552316544:12345-0@lo:700: Request processed in 264970us (265170us total) trans 0 rc 0/0 00000100:00100000:0.0:1787852952.833485:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000001:00080000:0.0:1787852952.833549:0:7641:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:0.0:1787852952.833609:0:7641:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00080000:3.0:1787852952.833774:0:7879:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f49079f1a40 x1874699552316544/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787852968 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787852952.833799:0:7879:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49079f1a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7879:1874699552316544:0@lo:700: 00000004:02000040:3.0:1787852952.984059:0:7879:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:3.0:1787852953.004021:0:7879:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f492eb74000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7879:1874699552316928:0@lo:5: 00000100:00100000:3.0:1787852953.004138:0:7879:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787852953.004234:0:7879:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f490316bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787852953.007069:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552316928 00000100:00100000:3.0:1787852953.007101:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552316928 00000100:00100000:3.0:1787852953.007230:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787852953.007245:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f492eb770c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:7879:x1874699552316928:12345-0@lo:5: 00002000:00080000:2.0:1787852953.028740:0:6682:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1787852953.028778:0:6682:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:2.0:1787852953.049263:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f492eb770c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7879:x1874699552316928:12345-0@lo:5: Request processed in 42004us (45106us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1787852953.049285:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1787852953.051741:0:7879:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f492eb74000 x1874699552316928/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787852969 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787852953.051764:0:7879:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1787852953.051795:0:7879:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8f492eb74000 x1874699552316928/t4294967298(4294967298) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787852969 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787852953.051819:0:7879:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f492eb74000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7879:1874699552316928:0@lo:5: 00000004:00080000:0.0:1787852953.051842:0:7879:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:1.0:1787852953.389984:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787852954.417434:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787852955.434752:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787852955.447432:0:7989:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg401-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787852956.458502:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787852957.420302:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49417430c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552317312:0@lo:400: 00000100:00100000:2.0:1787852957.420425:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787852957.420504:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787852957.420511:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4941741680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1874699552317440:0@lo:400: 00000100:00100000:2.0:1787852957.420540:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787852957.420611:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552317440 00000100:00100000:2.0:1787852957.420621:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552317440 00000100:00100000:2.0:1787852957.420695:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787852957.420707:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4904cd4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874699552317440:12345-0@lo:400: 00000100:00100000:2.0:1787852957.420803:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4904cd4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874699552317440:12345-0@lo:400: Request processed in 99us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1787852957.420811:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787852957.420948:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4941740b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5d48a955-7010-4118-9c7d-f396984ae1ff:3308:1874699552317056:0@lo:400: 00000100:00100000:0.0:1787852957.420989:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787852957.421018:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4941743840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1874699552317568:0@lo:400: 00000100:00100000:0.0:1787852957.421054:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787852957.421075:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787852957.421079:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4941742d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874699552317184:0@lo:400: 00000100:00100000:0.0:1787852957.421102:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787852957.421129:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49216e6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874699552317696:0@lo:400: 00000100:00100000:0.0:1787852957.421152:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787852957.421180:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552317568 00000100:00100000:0.0:1787852957.421184:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552317568 00000100:00100000:0.0:1787852957.421207:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552317184 00000100:00100000:0.0:1787852957.421210:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552317184 00000100:00100000:0.0:1787852957.421236:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787852957.421243:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49079f0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874699552317568:12345-0@lo:400: 00000100:00100000:0.0:1787852957.421282:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49079f0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874699552317568:12345-0@lo:400: Request processed in 39us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1787852957.421288:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787852957.421304:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787852957.421310:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49079f3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874699552317184:12345-0@lo:400: 00000100:00100000:0.0:1787852957.421338:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49079f3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874699552317184:12345-0@lo:400: Request processed in 28us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1787852957.421343:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787852957.421361:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552317312 00000100:00100000:0.0:1787852957.421364:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552317312 00000100:00100000:0.0:1787852957.421387:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552317696 00000100:00100000:0.0:1787852957.421389:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552317696 00000100:00100000:0.0:1787852957.421402:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787852957.421407:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4904cd6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874699552317312:12345-0@lo:400: 00000100:00100000:0.0:1787852957.421435:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4904cd6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874699552317312:12345-0@lo:400: Request processed in 28us (1012us total) trans 0 rc 0/0 00000100:00100000:0.0:1787852957.421440:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787852957.421449:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787852957.421454:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49079f03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3308:x1874699552317696:12345-0@lo:400: 00000100:00100000:0.0:1787852957.421473:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49079f03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3308:x1874699552317696:12345-0@lo:400: Request processed in 19us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1787852957.421479:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1787852957.421511:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f4941742d00 x1874699552317184/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787852973 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787852957.421526:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4941742d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874699552317184:0@lo:400: 00010000:00080000:0.0:1787852957.421544:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f49216e6940 x1874699552317696/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787852973 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787852957.421553:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49216e6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874699552317696:0@lo:400: 00010000:00080000:0.0:1787852957.421562:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f4941743840 x1874699552317568/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787852973 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787852957.421591:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4941743840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1874699552317568:0@lo:400: 00000100:00080000:2.0:1787852957.422286:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787852957.422295:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787852957.422297:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787852957.422351:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f4941741680 x1874699552317440/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787852973 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787852957.422363:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4941741680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1874699552317440:0@lo:400: 00010000:00080000:2.0:1787852957.422373:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f49417430c0 x1874699552317312/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787852973 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787852957.422380:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49417430c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552317312:0@lo:400: 00000100:00100000:1.0:1787852957.423918:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552317056 00000100:00100000:1.0:1787852957.423937:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552317056 00000100:00100000:1.0:1787852957.424014:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787852957.424025:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4906230050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+19:3308:x1874699552317056:12345-0@lo:400: 00000100:00100000:1.0:1787852957.424185:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4906230050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+19:3308:x1874699552317056:12345-0@lo:400: Request processed in 162us (3195us total) trans 0 rc 0/0 00000100:00100000:1.0:1787852957.424193:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787852957.424539:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4941740b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5d48a955-7010-4118-9c7d-f396984ae1ff:3308:1874699552317056:0@lo:400: 00010000:00010000:1.0:1787852957.502645:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787852957.930297:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49079f1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552317824:0@lo:13: 00000100:00100000:1.0:1787852957.930403:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787852957.931923:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552317824 00000100:00100000:0.0:1787852957.931944:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552317824 00000100:00100000:0.0:1787852957.932046:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787852957.932059:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4921694780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874699552317824:12345-0@lo:13: 00002000:00000024:0.0:1787852957.932124:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787852957.932234:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4921694780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874699552317824:12345-0@lo:13: Request processed in 178us (1831us total) trans 0 rc 0/0 00000100:00100000:0.0:1787852957.932242:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1787852957.932943:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f49079f1680 x1874699552317824/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787852973 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787852957.932970:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49079f1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552317824:0@lo:13: 00000100:00100000:1.0:1787852957.942608:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787852957.942644:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4921696d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552317952:0@lo:13: 00000100:00100000:1.0:1787852957.942760:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787852957.948066:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552317952 00000100:00100000:1.0:1787852957.948090:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552317952 00000100:00100000:1.0:1787852957.950635:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787852957.954314:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4921697840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1874699552317952:12345-0@lo:13: 00002000:00000024:1.0:1787852957.962467:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787852957.998386:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4921697840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1874699552317952:12345-0@lo:13: Request processed in 47711us (55607us total) trans 0 rc 0/0 00000100:00100000:0.0:1787852957.998413:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1787852957.998510:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f4921696d00 x1874699552317952/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787852973 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787852957.998559:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4921696d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552317952:0@lo:13: 00000001:00080000:3.0:1787852958.138364:0:7641:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:0.0:1787852958.509149:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787852959.529995:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787852960.555076:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787852961.583012:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787852962.547892:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49079f0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552318336:0@lo:400: 00000100:00100000:0.0:1787852962.547981:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787852962.548177:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787852962.548185:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49079f12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1874699552318464:0@lo:400: 00000100:00100000:0.0:1787852962.548231:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787852962.548268:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552318336 00000100:00100000:0.0:1787852962.548277:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552318336 00000100:00100000:0.0:1787852962.549183:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787852962.549199:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49079f1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874699552318336:12345-0@lo:400: 00000100:00100000:0.0:1787852962.549274:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49079f1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874699552318336:12345-0@lo:400: Request processed in 82us (1292us total) trans 0 rc 0/0 00000100:00100000:0.0:1787852962.549281:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787852962.549490:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49079f1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5d48a955-7010-4118-9c7d-f396984ae1ff:3308:1874699552318080:0@lo:400: 00000100:00100000:1.0:1787852962.549546:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787852962.549598:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49079f3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1874699552318592:0@lo:400: 00000100:00100000:1.0:1787852962.549640:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787852962.549667:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787852962.549674:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49079f1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874699552318208:0@lo:400: 00000100:00100000:1.0:1787852962.549715:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787852962.549733:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49079f2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874699552318720:0@lo:400: 00000100:00100000:1.0:1787852962.549761:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787852962.549793:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552318464 00000100:00100000:1.0:1787852962.549813:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552318464 00000100:00100000:1.0:1787852962.549847:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552318592 00000100:00100000:1.0:1787852962.549851:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552318592 00000100:00100000:1.0:1787852962.549866:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552318208 00000100:00100000:1.0:1787852962.549869:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552318208 00000100:00100000:1.0:1787852962.549881:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787852962.549886:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49216e6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874699552318464:12345-0@lo:400: 00000100:00100000:1.0:1787852962.549924:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49216e6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874699552318464:12345-0@lo:400: Request processed in 37us (1693us total) trans 0 rc 0/0 00000100:00100000:1.0:1787852962.549931:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787852962.549945:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787852962.549951:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49216970c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874699552318592:12345-0@lo:400: 00000100:00100000:1.0:1787852962.549983:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49216970c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874699552318592:12345-0@lo:400: Request processed in 33us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1787852962.549988:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787852962.550000:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787852962.550006:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4921695a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874699552318208:12345-0@lo:400: 00000100:00100000:1.0:1787852962.550049:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4921695a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874699552318208:12345-0@lo:400: Request processed in 43us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1787852962.550075:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787852962.550096:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552318720 00000100:00100000:1.0:1787852962.550100:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552318720 00000100:00100000:1.0:1787852962.550120:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787852962.550127:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4921696d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1874699552318720:12345-0@lo:400: 00000100:00100000:1.0:1787852962.550158:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4921696d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1874699552318720:12345-0@lo:400: Request processed in 32us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1787852962.550163:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1787852962.550196:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f49079f1a40 x1874699552318208/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787852978 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787852962.550208:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49079f1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874699552318208:0@lo:400: 00010000:00080000:1.0:1787852962.550219:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f49079f2d00 x1874699552318720/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787852978 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787852962.550226:0:3308:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1787852962.550241:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49079f2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874699552318720:0@lo:400: 00010000:00080000:1.0:1787852962.550251:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f49079f3c00 x1874699552318592/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787852978 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787852962.550259:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49079f3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1874699552318592:0@lo:400: 00010000:00080000:1.0:1787852962.550602:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f49079f12c0 x1874699552318464/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787852978 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787852962.550613:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49079f12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1874699552318464:0@lo:400: 00010000:00080000:1.0:1787852962.550627:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f49079f0f00 x1874699552318336/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787852978 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787852962.550635:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49079f0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552318336:0@lo:400: 00000100:00100000:3.0:1787852962.555916:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552318080 00000100:00100000:3.0:1787852962.555934:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552318080 00000100:00100000:3.0:1787852962.556030:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787852962.556041:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4906230c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d48a955-7010-4118-9c7d-f396984ae1ff+19:3308:x1874699552318080:12345-0@lo:400: 00000100:00100000:3.0:1787852962.556187:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4906230c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d48a955-7010-4118-9c7d-f396984ae1ff+19:3308:x1874699552318080:12345-0@lo:400: Request processed in 147us (6639us total) trans 0 rc 0/0 00000100:00100000:3.0:1787852962.556195:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787852962.556266:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49079f1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5d48a955-7010-4118-9c7d-f396984ae1ff:3308:1874699552318080:0@lo:400: 00000100:00080000:3.0:1787852962.563400:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787852962.563442:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787852962.563445:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787852962.602857:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787852963.049941:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787852963.050057:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49417403c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874699552318848:0@lo:13: 00000100:00100000:0.0:1787852963.050166:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787852963.052766:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787852963.052791:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4921696940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552318976:0@lo:13: 00000100:00100000:1.0:1787852963.052874:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787852963.057686:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552318848 00000100:00100000:0.0:1787852963.057707:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552318848 00000100:00100000:0.0:1787852963.057773:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552318976 00000100:00100000:0.0:1787852963.057777:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552318976 00000100:00100000:0.0:1787852963.057799:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787852963.057825:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4941740b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874699552318848:12345-0@lo:13: 00002000:00000024:0.0:1787852963.058284:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787852963.058384:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4941740b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874699552318848:12345-0@lo:13: Request processed in 562us (8220us total) trans 0 rc 0/0 00000100:00100000:0.0:1787852963.058393:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787852963.058414:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787852963.058421:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4921697480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874699552318976:12345-0@lo:13: 00002000:00000024:0.0:1787852963.058441:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787852963.058472:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4921697480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874699552318976:12345-0@lo:13: Request processed in 52us (5598us total) trans 0 rc 0/0 00000100:00100000:0.0:1787852963.058479:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:1.0:1787852963.059981:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f4921696940 x1874699552318976/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787852979 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787852963.060018:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4921696940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552318976:0@lo:13: 00010000:00080000:2.0:1787852963.060186:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f49417403c0 x1874699552318848/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787852979 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787852963.060203:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49417403c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874699552318848:0@lo:13: 00010000:00010000:0.0:1787852963.633338:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787852963.984483:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787852963.984630:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526078592 00000100:00100000:1.0:1787852963.984642:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526078592 00000100:00100000:1.0:1787852963.984790:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 114 00000100:00100000:1.0:1787852963.984801:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4906233050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2361:x1874699526078592:12345-192.168.204.1@tcp:250: 00010000:00080000:1.0:1787852963.984843:0:5829:0:(ldlm_lib.c:1454:target_handle_connect()) MGS: connection from af755b38-4932-400a-92cc-ddad0ca077a5@192.168.204.1@tcp t0 exp 0000000000000000 cur 283 last 0 00000020:00000080:1.0:1787852963.984889:0:5829:0:(genops.c:1385:class_connect()) connect: client af755b38-4932-400a-92cc-ddad0ca077a5, cookie 0x710df789068e613d 00000100:00080000:1.0:1787852963.985069:0:5829:0:(import.c:65:import_set_state_nolock()) ffff8f493fd05800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787852963.985151:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4906233050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af755b38-4932-400a-92cc-ddad0ca077a5+5:2361:x1874699526078592:12345-192.168.204.1@tcp:250: Request processed in 350us (685us total) trans 0 rc 0/0 00000100:00100000:1.0:1787852963.985159:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 114 00000100:00100000:0.0:1787852963.993653:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787852963.994441:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526078720 00000100:00100000:3.0:1787852963.994454:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526078720 00000100:00100000:3.0:1787852963.994525:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 115 00000100:00100000:3.0:1787852963.994537:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4906231850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af755b38-4932-400a-92cc-ddad0ca077a5+5:5595:x1874699526078720:12345-192.168.204.1@tcp:101: 00010000:00010000:3.0:1787852963.994555:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787852963.994598:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f49029cc000/0x710df789068e6144 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xd0a9c507938950e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852963.994632:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f49029cc000/0x710df789068e6144 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c507938950e expref: 6 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852963.994645:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f49029cc000/0x710df789068e6144 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c507938950e expref: 6 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852963.994655:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49029cc000, rc 0) 00000100:00100000:3.0:1787852963.994720:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4906231850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af755b38-4932-400a-92cc-ddad0ca077a5+6:5595:x1874699526078720:12345-192.168.204.1@tcp:101: Request processed in 186us (1078us total) trans 0 rc 0/0 00000100:00100000:3.0:1787852963.994728:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 115 00000100:00100000:0.0:1787852964.004351:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787852964.004544:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526078848 00000100:00100000:3.0:1787852964.004556:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526078848 00000100:00100000:3.0:1787852964.004697:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 116 00000100:00100000:3.0:1787852964.004708:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4906230450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af755b38-4932-400a-92cc-ddad0ca077a5+6:5595:x1874699526078848:12345-192.168.204.1@tcp:501: 00000100:00100000:3.0:1787852964.005749:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4906230450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af755b38-4932-400a-92cc-ddad0ca077a5+6:5595:x1874699526078848:12345-192.168.204.1@tcp:501: Request processed in 1033us (1402us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787852964.005760:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 116 00000100:00100000:3.0:1787852964.009190:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787852964.010287:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526078976 00000100:00100000:2.0:1787852964.010301:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526078976 00000100:00100000:2.0:1787852964.010370:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 117 00000100:00100000:2.0:1787852964.010381:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4906233850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af755b38-4932-400a-92cc-ddad0ca077a5+6:5595:x1874699526078976:12345-192.168.204.1@tcp:101: 00010000:00010000:2.0:1787852964.010402:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787852964.010433:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f49013fd400/0x710df789068e614b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xd0a9c5079389515 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787852964.010482:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f49013fd400/0x710df789068e614b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389515 expref: 7 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787852964.010495:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f49013fd400/0x710df789068e614b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389515 expref: 7 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787852964.010506:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49013fd400, rc 0) 00000100:00100000:2.0:1787852964.010589:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4906233850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af755b38-4932-400a-92cc-ddad0ca077a5+7:5595:x1874699526078976:12345-192.168.204.1@tcp:101: Request processed in 209us (1408us total) trans 0 rc 0/0 00000100:00100000:2.0:1787852964.010607:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 117 00000100:00100000:3.0:1787852964.015643:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787852964.015872:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526079104 00000100:00100000:1.0:1787852964.015886:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526079104 00000100:00100000:2.0:1787852964.016026:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 118 00000100:00100000:2.0:1787852964.016041:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f490621c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af755b38-4932-400a-92cc-ddad0ca077a5+7:5595:x1874699526079104:12345-192.168.204.1@tcp:501: 00000100:00100000:2.0:1787852964.016612:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f490621c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af755b38-4932-400a-92cc-ddad0ca077a5+8:5595:x1874699526079104:12345-192.168.204.1@tcp:501: Request processed in 572us (980us total) trans 0 rc 0/0 00000100:00100000:2.0:1787852964.016624:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 118 00000100:00100000:0.0:1787852964.019610:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787852964.019699:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526079232 00000100:00100000:3.0:1787852964.019712:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526079232 00000100:00100000:3.0:1787852964.020113:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 119 00000100:00100000:3.0:1787852964.020126:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f490621c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af755b38-4932-400a-92cc-ddad0ca077a5+8:5595:x1874699526079232:12345-192.168.204.1@tcp:503: 00000100:00100000:3.0:1787852964.020873:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f490621c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af755b38-4932-400a-92cc-ddad0ca077a5+8:5595:x1874699526079232:12345-192.168.204.1@tcp:503: Request processed in 746us (1271us total) trans 0 rc 0/0 00000100:00100000:3.0:1787852964.020884:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 119 00000100:00100000:0.0:1787852964.025188:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787852964.025305:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526079360 00000100:00100000:3.0:1787852964.025441:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526079360 00000100:00100000:3.0:1787852964.025499:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 120 00000100:00100000:3.0:1787852964.025511:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f490621e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af755b38-4932-400a-92cc-ddad0ca077a5+8:5614:x1874699526079360:12345-192.168.204.1@tcp:502: 00000100:00100000:2.0:1787852964.027058:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f490621e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af755b38-4932-400a-92cc-ddad0ca077a5+8:5614:x1874699526079360:12345-192.168.204.1@tcp:502: Request processed in 1537us (1870us total) trans 0 rc 0/0 00000100:00100000:2.0:1787852964.027077:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 120 00000100:00100000:3.0:1787852964.069761:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787852964.069802:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526079488 00000100:00100000:3.0:1787852964.069812:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526079488 00000100:00100000:3.0:1787852964.069865:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 121 00000100:00100000:3.0:1787852964.069891:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f490621f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af755b38-4932-400a-92cc-ddad0ca077a5+8:5614:x1874699526079488:12345-192.168.204.1@tcp:502: 00000100:00100000:3.0:1787852964.070191:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f490621f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af755b38-4932-400a-92cc-ddad0ca077a5+8:5614:x1874699526079488:12345-192.168.204.1@tcp:502: Request processed in 316us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1787852964.070199:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 121 00000100:00100000:2.0:1787852964.080516:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787852964.081164:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526079616 00000100:00100000:3.0:1787852964.081176:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526079616 00000100:00100000:3.0:1787852964.081227:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 122 00000100:00100000:3.0:1787852964.081238:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f490621f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af755b38-4932-400a-92cc-ddad0ca077a5+8:5595:x1874699526079616:12345-192.168.204.1@tcp:101: 00010000:00010000:3.0:1787852964.081255:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787852964.081274:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f49029cce00/0x710df789068e6152 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd0a9c507938953f expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852964.081326:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f49029cce00/0x710df789068e6152 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c507938953f expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852964.081340:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f49029cce00/0x710df789068e6152 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c507938953f expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852964.081350:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49029cce00, rc 0) 00000100:00100000:3.0:1787852964.081418:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f490621f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af755b38-4932-400a-92cc-ddad0ca077a5+9:5595:x1874699526079616:12345-192.168.204.1@tcp:101: Request processed in 181us (914us total) trans 0 rc 0/0 00000100:00100000:3.0:1787852964.082691:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 122 00000100:00100000:2.0:1787852964.097145:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787852964.097178:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526079744 00000100:00100000:2.0:1787852964.097187:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526079744 00000100:00100000:2.0:1787852964.097230:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 123 00000100:00100000:2.0:1787852964.097238:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f490621d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af755b38-4932-400a-92cc-ddad0ca077a5+9:5595:x1874699526079744:12345-192.168.204.1@tcp:256: 20000000:01000000:2.0:1787852964.097266:0:5829:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1787852964.097290:0:5829:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787852964.097294:0:5829:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1787852964.097298:0:5829:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1787852964.097300:0:5829:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1787852964.099412:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f490621d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af755b38-4932-400a-92cc-ddad0ca077a5+9:5595:x1874699526079744:12345-192.168.204.1@tcp:256: Request processed in 2164us (2269us total) trans 0 rc 0/0 00000100:00100000:0.0:1787852964.100009:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 123 00000100:00100000:1.0:1787852964.110837:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787852964.111046:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526079872 00000100:00100000:3.0:1787852964.111056:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526079872 00000100:00100000:3.0:1787852964.111115:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 124 00000100:00100000:3.0:1787852964.111126:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f490621fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af755b38-4932-400a-92cc-ddad0ca077a5+9:5595:x1874699526079872:12345-192.168.204.1@tcp:101: 00010000:00010000:3.0:1787852964.111146:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787852964.111166:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f49421e3000/0x710df789068e6159 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd0a9c5079389546 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852964.111195:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f49421e3000/0x710df789068e6159 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389546 expref: 10 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852964.111207:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f49421e3000/0x710df789068e6159 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389546 expref: 10 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852964.111216:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49421e3000, rc 0) 00000100:00100000:3.0:1787852964.111280:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f490621fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af755b38-4932-400a-92cc-ddad0ca077a5+10:5595:x1874699526079872:12345-192.168.204.1@tcp:101: Request processed in 156us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1787852964.111300:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 124 00000100:00100000:2.0:1787852964.121267:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787852964.121400:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526080000 00000100:00100000:3.0:1787852964.121412:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526080000 00000100:00100000:3.0:1787852964.121485:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 125 00000100:00100000:3.0:1787852964.121495:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f490621d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af755b38-4932-400a-92cc-ddad0ca077a5+10:5595:x1874699526080000:12345-192.168.204.1@tcp:501: 00000100:00100000:3.0:1787852964.122069:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f490621d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af755b38-4932-400a-92cc-ddad0ca077a5+10:5595:x1874699526080000:12345-192.168.204.1@tcp:501: Request processed in 573us (810us total) trans 0 rc 0/0 00000100:00100000:3.0:1787852964.122078:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 125 00000100:00100000:3.0:1787852964.124837:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787852964.125051:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526080128 00000100:00100000:1.0:1787852964.125063:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526080128 00000100:00100000:1.0:1787852964.125116:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 126 00000100:00100000:1.0:1787852964.125127:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f490621e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af755b38-4932-400a-92cc-ddad0ca077a5+10:5595:x1874699526080128:12345-192.168.204.1@tcp:503: 00000100:00100000:1.0:1787852964.125620:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f490621e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af755b38-4932-400a-92cc-ddad0ca077a5+10:5595:x1874699526080128:12345-192.168.204.1@tcp:503: Request processed in 493us (792us total) trans 0 rc 0/0 00000100:00100000:1.0:1787852964.125629:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 126 00000100:00100000:1.0:1787852964.135547:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787852964.136130:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526080256 00000100:00100000:3.0:1787852964.136141:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526080256 00000100:00100000:3.0:1787852964.136205:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 127 00000100:00100000:3.0:1787852964.136215:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f490621ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af755b38-4932-400a-92cc-ddad0ca077a5+10:5619:x1874699526080256:12345-192.168.204.1@tcp:502: 00000100:00100000:3.0:1787852964.136522:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f490621ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af755b38-4932-400a-92cc-ddad0ca077a5+10:5619:x1874699526080256:12345-192.168.204.1@tcp:502: Request processed in 307us (983us total) trans 0 rc 0/0 00000100:00100000:3.0:1787852964.136531:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 127 00000100:00100000:2.0:1787852964.143313:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787852964.143360:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526080384 00000100:00100000:2.0:1787852964.143371:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526080384 00000100:00100000:2.0:1787852964.143444:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 128 00000100:00100000:2.0:1787852964.143455:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4904f57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af755b38-4932-400a-92cc-ddad0ca077a5+10:5619:x1874699526080384:12345-192.168.204.1@tcp:502: 00000100:00100000:2.0:1787852964.143708:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4904f57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af755b38-4932-400a-92cc-ddad0ca077a5+10:5619:x1874699526080384:12345-192.168.204.1@tcp:502: Request processed in 255us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1787852964.143729:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 128 00000100:00100000:2.0:1787852964.154968:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787852964.155118:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526080512 00000100:00100000:3.0:1787852964.155131:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526080512 00000100:00100000:3.0:1787852964.155189:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 4 00000100:00100000:3.0:1787852964.155198:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4904cd5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2361:x1874699526080512:12345-192.168.204.1@tcp:38: 00010000:00080000:3.0:1787852964.155231:0:5838:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-MDT0000: connection from b1d98f5a-0be0-4f69-83a6-833c935c8205@192.168.204.1@tcp t0 exp 0000000000000000 cur 283 last 0 00000020:00000080:3.0:1787852964.155275:0:5838:0:(genops.c:1385:class_connect()) connect: client b1d98f5a-0be0-4f69-83a6-833c935c8205, cookie 0x710df789068e6160 00000004:00100000:3.0:1787852964.155310:0:5838:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1787852964.155317:0:5838:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:3.0:1787852964.187513:0:5838:0:(import.c:65:import_set_state_nolock()) ffff8f49079ea000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787852964.188020:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4904cd5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+6:2361:x1874699526080512:12345-192.168.204.1@tcp:38: Request processed in 32818us (33060us total) trans 0 rc 0/0 00000100:00100000:3.0:1787852964.188034:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 4 00010000:00010000:2.0:1787852964.654521:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787852965.204106:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787852965.204185:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787852965.204261:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526080640 00000100:00100000:1.0:1787852965.204272:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526080640 00000100:00100000:1.0:1787852965.204370:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526080768 00000100:00100000:1.0:1787852965.204374:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526080768 00000100:00100000:3.0:1787852965.204388:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 5 00000100:00100000:3.0:1787852965.204399:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4904cd43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+7:0:x1874699526080640:12345-192.168.204.1@tcp:41: 00000004:00000024:3.0:1787852965.204449:0:5836:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00080000:2.0:1787852965.204462:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787852965.204528:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4904cd43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+7:0:x1874699526080640:12345-192.168.204.1@tcp:41: Request processed in 130us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1787852965.204535:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 5 00000100:00100000:3.0:1787852965.204553:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 6 00000100:00100000:3.0:1787852965.204559:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49415a7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+6:5595:x1874699526080768:12345-192.168.204.1@tcp:41: 00000004:00000024:3.0:1787852965.204592:0:5836:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1787852965.204614:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49415a7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+6:5595:x1874699526080768:12345-192.168.204.1@tcp:41: Request processed in 55us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1787852965.204621:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 6 00000100:00100000:0.0:1787852965.208541:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787852965.208664:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526080896 00000100:00100000:3.0:1787852965.208683:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526080896 00000100:00100000:3.0:1787852965.208757:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 7 00000100:00100000:3.0:1787852965.208767:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49417430c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+6:5595:x1874699526080896:12345-192.168.204.1@tcp:40: 00000100:00100000:3.0:1787852965.208856:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49417430c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+6:5595:x1874699526080896:12345-192.168.204.1@tcp:40: Request processed in 91us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1787852965.208863:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 7 00000100:00100000:2.0:1787852965.220564:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787852965.220637:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787852965.220682:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787852965.220722:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787852965.220754:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526081408 00000100:00100000:2.0:1787852965.220763:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526081408 00000100:00100000:2.0:1787852965.220814:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 129 00000100:00100000:2.0:1787852965.220824:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4904f54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af755b38-4932-400a-92cc-ddad0ca077a5+10:2365:x1874699526081408:12345-192.168.204.1@tcp:400: 00000100:00100000:2.0:1787852965.220896:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4904f54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af755b38-4932-400a-92cc-ddad0ca077a5+10:2365:x1874699526081408:12345-192.168.204.1@tcp:400: Request processed in 73us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1787852965.220921:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 129 00000100:00100000:0.0:1787852965.221179:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526081024 00000100:00100000:0.0:1787852965.221185:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526081024 00000100:00100000:0.0:1787852965.221215:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526081152 00000100:00100000:0.0:1787852965.221217:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526081152 00000100:00100000:0.0:1787852965.221229:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 9 00000100:00100000:0.0:1787852965.221235:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49415a52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2361:x1874699526081024:12345-192.168.204.1@tcp:8: 00010000:00080000:0.0:1787852965.221259:0:6682:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0000: connection from b1d98f5a-0be0-4f69-83a6-833c935c8205@192.168.204.1@tcp t0 exp 0000000000000000 cur 284 last 0 00000020:00000080:0.0:1787852965.221290:0:6682:0:(genops.c:1385:class_connect()) connect: client b1d98f5a-0be0-4f69-83a6-833c935c8205, cookie 0x710df789068e6167 00002000:00100000:0.0:1787852965.221318:0:6682:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli b1d98f5a-0be0-4f69-83a6-833c935c8205/ffff8f49415c8800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113954 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787852965.221349:0:6682:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787852965.221768:0:6682:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787852965.221799:0:6682:0:(import.c:65:import_set_state_nolock()) ffff8f49415cf800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787852965.221840:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49415a52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+6:2361:x1874699526081024:12345-192.168.204.1@tcp:8: Request processed in 604us (1203us total) trans 0 rc 0/0 00000100:00100000:0.0:1787852965.221850:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 9 00000100:00100000:0.0:1787852965.221867:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 10 00000100:00100000:0.0:1787852965.221872:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49415a4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2361:x1874699526081152:12345-192.168.204.1@tcp:8: 00010000:00080000:0.0:1787852965.221889:0:6682:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0001: connection from b1d98f5a-0be0-4f69-83a6-833c935c8205@192.168.204.1@tcp t0 exp 0000000000000000 cur 284 last 0 00000020:00000080:0.0:1787852965.221915:0:6682:0:(genops.c:1385:class_connect()) connect: client b1d98f5a-0be0-4f69-83a6-833c935c8205, cookie 0x710df789068e616e 00002000:00100000:0.0:1787852965.221921:0:6682:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli b1d98f5a-0be0-4f69-83a6-833c935c8205/ffff8f49415cd800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113954 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787852965.221937:0:6682:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787852965.222146:0:6682:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787852965.222161:0:6682:0:(import.c:65:import_set_state_nolock()) ffff8f49415cc000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787852965.222184:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49415a4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+6:2361:x1874699526081152:12345-192.168.204.1@tcp:8: Request processed in 310us (1502us total) trans 0 rc 0/0 00000100:00100000:0.0:1787852965.222190:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 10 00000100:00100000:1.0:1787852965.223153:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526081280 00000100:00100000:1.0:1787852965.223162:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526081280 00000100:00100000:1.0:1787852965.223223:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 0 00000100:00100000:1.0:1787852965.223231:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49415a4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+6:5595:x1874699526081280:12345-192.168.204.1@tcp:33: 00000004:00080000:1.0:1787852965.289901:0:5839:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 66564us 00000004:00200000:3.0:1787852965.356676:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:3.0:1787852965.356896:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49415a4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+6:5595:x1874699526081280:12345-192.168.204.1@tcp:33: Request processed in 133659us (136335us total) trans 0 rc 0/0 00000100:00100000:3.0:1787852965.356913:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 0 00000100:00100000:2.0:1787852965.591724:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787852965.592637:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526081536 00000100:00100000:3.0:1787852965.592652:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526081536 00000100:00100000:3.0:1787852965.592761:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 8 00000100:00100000:3.0:1787852965.592775:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49415a5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+6:5636:x1874699526081536:12345-192.168.204.1@tcp:101: 00010000:00010000:3.0:1787852965.592800:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787852965.592899:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21e00/0x710df789068e6175 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c5079389570 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852965.592993:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e617c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852965.593008:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e617c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852965.593024:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e617c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787852965.593242:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1787852965.593246:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787852965.593324:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e617c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852965.593352:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21e00/0x710df789068e6175 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389570 expref: 8 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852965.593369:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e617c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389570 expref: 7 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852965.593377:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f4910f92200) 00010000:00010000:3.0:1787852965.593380:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787852965.593389:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4921e20000, rc 0) 00000100:00100000:3.0:1787852965.594008:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49415a5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+7:5636:x1874699526081536:12345-192.168.204.1@tcp:101: Request processed in 1234us (2297us total) trans 0 rc 0/0 00000100:00100000:3.0:1787852965.594017:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 8 00010000:00010000:0.0:1787852965.673948:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787852966.699088:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787852967.658372:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4941743840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874699552319232:0@lo:400: 00000100:00100000:1.0:1787852967.658455:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787852967.658519:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f494159e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874699552319744:0@lo:400: 00000100:00100000:1.0:1787852967.658545:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787852967.658595:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787852967.658601:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4941741680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5d48a955-7010-4118-9c7d-f396984ae1ff:3309:1874699552319104:0@lo:400: 00000100:00100000:1.0:1787852967.658638:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787852967.658655:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f494159de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1874699552319616:0@lo:400: 00000100:00100000:1.0:1787852967.658673:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787852967.658883:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552319232 00000100:00100000:0.0:1787852967.658891:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552319232 00000100:00100000:0.0:1787852967.658947:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552319616 00000100:00100000:0.0:1787852967.658950:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552319616 00000100:00100000:0.0:1787852967.658985:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787852967.658994:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4921696940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874699552319232:12345-0@lo:400: 00000100:00100000:0.0:1787852967.659052:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4921696940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874699552319232:12345-0@lo:400: Request processed in 59us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1787852967.659058:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787852967.659075:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787852967.659081:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4921696580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874699552319616:12345-0@lo:400: 00000100:00100000:0.0:1787852967.659107:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4921696580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874699552319616:12345-0@lo:400: Request processed in 26us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1787852967.659112:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787852967.659129:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552319744 00000100:00100000:0.0:1787852967.659132:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552319744 00000100:00100000:0.0:1787852967.659161:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787852967.659167:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4921695680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1874699552319744:12345-0@lo:400: 00000100:00100000:0.0:1787852967.659207:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4921695680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1874699552319744:12345-0@lo:400: Request processed in 40us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1787852967.659212:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787852967.659258:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f494159de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1874699552319616:0@lo:400: 00000100:00100000:0.0:1787852967.659271:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4941743840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874699552319232:0@lo:400: 00010000:00080000:0.0:1787852967.659283:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f494159e580 x1874699552319744/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787852983 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787852967.659292:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f494159e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874699552319744:0@lo:400: 00000100:00100000:2.0:1787852967.659454:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4941742d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552319360:0@lo:400: 00000100:00100000:2.0:1787852967.659487:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787852967.659512:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787852967.659519:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49417403c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1874699552319488:0@lo:400: 00000100:00100000:2.0:1787852967.659542:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787852967.659601:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552319104 00000100:00100000:2.0:1787852967.659605:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552319104 00000100:00100000:2.0:1787852967.659637:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1787852967.659643:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4904f55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+19:3309:x1874699552319104:12345-0@lo:400: 00000100:00100000:2.0:1787852967.659679:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4904f55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+19:3309:x1874699552319104:12345-0@lo:400: Request processed in 36us (1040us total) trans 0 rc 0/0 00000100:00100000:2.0:1787852967.659699:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1787852967.659764:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4941741680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5d48a955-7010-4118-9c7d-f396984ae1ff:3309:1874699552319104:0@lo:400: 00000100:00100000:3.0:1787852967.659887:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552319488 00000100:00100000:3.0:1787852967.659892:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552319488 00000100:00100000:3.0:1787852967.659937:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787852967.659945:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49415a4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874699552319488:12345-0@lo:400: 00000100:00100000:3.0:1787852967.659983:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49415a4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874699552319488:12345-0@lo:400: Request processed in 40us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1787852967.659988:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787852967.660013:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49417403c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1874699552319488:0@lo:400: 00000100:00080000:1.0:1787852967.660207:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787852967.660213:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787852967.660483:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552319360 00000100:00100000:0.0:1787852967.660488:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552319360 00000100:00100000:0.0:1787852967.660550:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787852967.660558:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49415a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874699552319360:12345-0@lo:400: 00000100:00100000:0.0:1787852967.660627:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49415a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874699552319360:12345-0@lo:400: Request processed in 70us (1139us total) trans 0 rc 0/0 00000100:00100000:0.0:1787852967.660633:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1787852967.660662:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f4941742d00 x1874699552319360/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787852983 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787852967.660673:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4941742d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552319360:0@lo:400: 00000100:00080000:1.0:1787852967.660834:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787852967.721931:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787852968.034836:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787852968.035061:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526081664 00000100:00100000:2.0:1787852968.035073:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526081664 00000100:00100000:2.0:1787852968.035156:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 9 00000100:00100000:2.0:1787852968.035168:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f492eb75680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+7:5689:x1874699526081664:12345-192.168.204.1@tcp:41: 00000004:00000024:2.0:1787852968.035216:0:5836:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1787852968.035304:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f492eb75680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+7:5689:x1874699526081664:12345-192.168.204.1@tcp:41: Request processed in 138us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1787852968.035311:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 9 00000100:00080000:1.0:1787852968.036093:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787852968.038110:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787852968.038459:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526081792 00000100:00100000:2.0:1787852968.038489:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526081792 00000100:00100000:2.0:1787852968.038607:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 11 00000100:00100000:2.0:1787852968.038619:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f494159e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b1d98f5a-0be0-4f69-83a6-833c935c8205+6:5689:x1874699526081792:12345-192.168.204.1@tcp:13: 00002000:00000024:2.0:1787852968.038820:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787852968.038894:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f494159e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b1d98f5a-0be0-4f69-83a6-833c935c8205+6:5689:x1874699526081792:12345-192.168.204.1@tcp:13: Request processed in 277us (793us total) trans 0 rc 0/0 00000100:00100000:2.0:1787852968.038901:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 11 00000100:00080000:1.0:1787852968.039019:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787852968.042465:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787852968.042812:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526081920 00000100:00100000:2.0:1787852968.042823:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526081920 00000100:00100000:2.0:1787852968.042954:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 12 00000100:00100000:2.0:1787852968.042965:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f494159de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b1d98f5a-0be0-4f69-83a6-833c935c8205+6:5689:x1874699526081920:12345-192.168.204.1@tcp:13: 00002000:00000024:2.0:1787852968.043005:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787852968.043079:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f494159de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b1d98f5a-0be0-4f69-83a6-833c935c8205+6:5689:x1874699526081920:12345-192.168.204.1@tcp:13: Request processed in 116us (625us total) trans 0 rc 0/0 00000100:00100000:2.0:1787852968.043087:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 12 00000100:00080000:1.0:1787852968.044979:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787852968.169943:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787852968.169974:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49079f30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874699552319872:0@lo:13: 00000100:00100000:2.0:1787852968.170054:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787852968.170342:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f492eb76940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874699552320000:0@lo:13: 00000100:00100000:2.0:1787852968.170384:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787852968.170518:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552319872 00000100:00100000:1.0:1787852968.170526:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552319872 00000100:00100000:1.0:1787852968.170561:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552320000 00000100:00100000:1.0:1787852968.170594:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552320000 00000100:00100000:1.0:1787852968.170616:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787852968.170624:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49415a61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874699552319872:12345-0@lo:13: 00002000:00000024:1.0:1787852968.170646:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787852968.170701:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49415a61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874699552319872:12345-0@lo:13: Request processed in 77us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1787852968.170708:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1787852968.171083:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f49079f30c0 x1874699552319872/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787852984 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787852968.171103:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49079f30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874699552319872:0@lo:13: 00000100:00100000:1.0:1787852968.171456:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787852968.171466:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49415a7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874699552320000:12345-0@lo:13: 00002000:00000024:1.0:1787852968.171481:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787852968.171997:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49415a7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874699552320000:12345-0@lo:13: Request processed in 532us (1610us total) trans 0 rc 0/0 00000100:00100000:1.0:1787852968.172005:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1787852968.172307:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f492eb76940 x1874699552320000/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787852984 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787852968.172324:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f492eb76940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874699552320000:0@lo:13: 00010000:00010000:3.0:1787852968.747166:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787852968.804598:0:6712:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b1d98f5a-0be0-4f69-83a6-833c935c8205 00000001:00100000:1.0:1787852969.397137:0:5858:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of b1d98f5a-0be0-4f69-83a6-833c935c8205 00010000:00010000:3.0:1787852969.778031:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787852969.828024:0:7641:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b1d98f5a-0be0-4f69-83a6-833c935c8205 00000100:00100000:3.0:1787852970.304980:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787852970.305055:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787852970.305119:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787852970.305218:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787852970.305318:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526082176 00000100:00100000:2.0:1787852970.305329:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526082176 00000100:00100000:2.0:1787852970.305401:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 28 00000100:00100000:2.0:1787852970.305428:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f492eb74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+6:2362:x1874699526082176:12345-192.168.204.1@tcp:400: 00000100:00100000:2.0:1787852970.305513:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f492eb74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+6:2362:x1874699526082176:12345-192.168.204.1@tcp:400: Request processed in 101us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1787852970.305521:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 28 00000100:00100000:0.0:1787852970.306553:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526082432 00000100:00100000:0.0:1787852970.306561:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526082432 00000100:00100000:0.0:1787852970.306660:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526082304 00000100:00100000:0.0:1787852970.306663:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526082304 00000100:00100000:0.0:1787852970.306729:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 12 00000100:00100000:0.0:1787852970.306738:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f492eb77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+5:2362:x1874699526082432:12345-192.168.204.1@tcp:400: 00000100:00100000:0.0:1787852970.306782:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f492eb77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+5:2362:x1874699526082432:12345-192.168.204.1@tcp:400: Request processed in 45us (1726us total) trans 0 rc 0/0 00000100:00100000:0.0:1787852970.306788:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 12 00000100:00100000:0.0:1787852970.306804:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 13 00000100:00100000:0.0:1787852970.306811:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f492eb74f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+5:2362:x1874699526082304:12345-192.168.204.1@tcp:400: 00000100:00100000:0.0:1787852970.306834:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f492eb74f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+5:2362:x1874699526082304:12345-192.168.204.1@tcp:400: Request processed in 24us (1617us total) trans 0 rc 0/0 00000100:00100000:0.0:1787852970.306840:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 13 00000100:00080000:3.0:1787852970.307112:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787852970.307117:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787852970.307119:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787852970.309366:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526082048 00000100:00100000:1.0:1787852970.309382:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526082048 00000100:00100000:1.0:1787852970.310730:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 131 00000100:00100000:1.0:1787852970.310747:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4904f57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af755b38-4932-400a-92cc-ddad0ca077a5+10:2362:x1874699526082048:12345-192.168.204.1@tcp:400: 00000100:00100000:1.0:1787852970.310836:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4904f57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af755b38-4932-400a-92cc-ddad0ca077a5+10:2362:x1874699526082048:12345-192.168.204.1@tcp:400: Request processed in 96us (5717us total) trans 0 rc 0/0 00000100:00100000:1.0:1787852970.310845:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 131 00010000:00010000:3.0:1787852970.794143:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787852971.817714:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787852972.237281:0:8297:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:1.0:1787852972.778835:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f492eb74780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5d48a955-7010-4118-9c7d-f396984ae1ff:3308:1874699552320128:0@lo:400: 00000100:00100000:1.0:1787852972.778930:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787852972.779039:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552320128 00000100:00100000:2.0:1787852972.779046:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552320128 00000100:00100000:2.0:1787852972.779105:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1787852972.779115:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4904f56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+19:3308:x1874699552320128:12345-0@lo:400: 00000100:00100000:0.0:1787852972.780941:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f492eb76580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874699552320256:0@lo:400: 00000100:00100000:0.0:1787852972.781003:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787852972.781066:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552320256 00000100:00100000:0.0:1787852972.781073:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552320256 00000100:00100000:0.0:1787852972.781118:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787852972.781126:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f494159f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874699552320256:12345-0@lo:400: 00000100:00100000:0.0:1787852972.781174:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f494159f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874699552320256:12345-0@lo:400: Request processed in 48us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1787852972.781182:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787852972.781227:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f492eb76580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874699552320256:0@lo:400: 00000100:00100000:2.0:1787852972.790743:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4904f56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+19:3308:x1874699552320128:12345-0@lo:400: Request processed in 11616us (11800us total) trans 0 rc 0/0 00000100:00100000:2.0:1787852972.790760:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1787852972.794071:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f492eb76580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552320384:0@lo:400: 00000100:00100000:0.0:1787852972.794157:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787852972.794216:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787852972.794222:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f492eb76940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1874699552320512:0@lo:400: 00000100:00100000:0.0:1787852972.794247:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787852972.794304:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552320512 00000100:00100000:0.0:1787852972.794311:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552320512 00000100:00100000:0.0:1787852972.794369:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787852972.794380:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f494159c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874699552320512:12345-0@lo:400: 00000100:00100000:0.0:1787852972.794455:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f494159c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874699552320512:12345-0@lo:400: Request processed in 77us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1787852972.794462:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:0.0:1787852972.794484:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787852972.794498:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4920570780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874699552320768:0@lo:400: 00000100:00100000:0.0:1787852972.794532:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787852972.794638:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787852972.794645:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49141992c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1874699552320640:0@lo:400: 00000100:00100000:0.0:1787852972.794671:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787852972.794695:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552320384 00000100:00100000:0.0:1787852972.794699:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552320384 00000100:00100000:0.0:1787852972.794726:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552320768 00000100:00100000:0.0:1787852972.794728:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552320768 00000100:00100000:0.0:1787852972.794743:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787852972.794748:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f494159fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874699552320384:12345-0@lo:400: 00000100:00100000:0.0:1787852972.794779:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f494159fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874699552320384:12345-0@lo:400: Request processed in 30us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1787852972.794785:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787852972.794795:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787852972.794800:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f494159d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1874699552320768:12345-0@lo:400: 00000100:00100000:0.0:1787852972.794839:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f494159d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1874699552320768:12345-0@lo:400: Request processed in 38us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1787852972.794845:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787852972.794860:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552320640 00000100:00100000:0.0:1787852972.794871:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552320640 00000100:00100000:0.0:1787852972.794896:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787852972.794903:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f494159cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874699552320640:12345-0@lo:400: 00000100:00100000:0.0:1787852972.794931:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f494159cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874699552320640:12345-0@lo:400: Request processed in 29us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1787852972.794936:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:0.0:1787852972.794949:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787852972.794952:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787852972.794955:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787852972.794986:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f492eb76940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1874699552320512:0@lo:400: 00010000:00080000:0.0:1787852972.794998:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f492eb76580 x1874699552320384/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787852988 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787852972.795009:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f492eb76580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552320384:0@lo:400: 00000100:00100000:0.0:1787852972.795034:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49141992c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1874699552320640:0@lo:400: 00010000:00080000:0.0:1787852972.795043:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f4920570780 x1874699552320768/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787852988 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787852972.795052:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4920570780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874699552320768:0@lo:400: 00000100:00100000:1.0:1787852972.796360:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f492eb74780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5d48a955-7010-4118-9c7d-f396984ae1ff:3308:1874699552320128:0@lo:400: 00010000:00010000:0.0:1787852972.844177:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787852973.290734:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4920570780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874699552320896:0@lo:13: 00000100:00100000:2.0:1787852973.290826:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787852973.290922:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787852973.290930:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49415a5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874699552321024:0@lo:13: 00000100:00100000:2.0:1787852973.290955:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787852973.291062:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552320896 00000100:00100000:3.0:1787852973.291072:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552320896 00000100:00100000:3.0:1787852973.291130:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552321024 00000100:00100000:3.0:1787852973.291134:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552321024 00000100:00100000:3.0:1787852973.291169:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787852973.291179:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49415a6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874699552320896:12345-0@lo:13: 00002000:00000024:3.0:1787852973.291225:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787852973.291302:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49415a6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874699552320896:12345-0@lo:13: Request processed in 123us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1787852973.291310:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787852973.291329:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787852973.291336:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49415a5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874699552321024:12345-0@lo:13: 00002000:00000024:3.0:1787852973.291357:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787852973.291388:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49415a5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874699552321024:12345-0@lo:13: Request processed in 52us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1787852973.291394:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:2.0:1787852973.291502:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f49415a5680 x1874699552321024/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787852989 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787852973.291522:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49415a5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874699552321024:0@lo:13: 00010000:00080000:2.0:1787852973.291537:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f4920570780 x1874699552320896/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787852989 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787852973.291548:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4920570780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874699552320896:0@lo:13: 00010000:00010000:3.0:1787852973.865845:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787852974.890799:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787852975.423345:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787852975.423388:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787852975.423427:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787852975.423460:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787852975.423486:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526082560 00000100:00100000:3.0:1787852975.423495:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526082560 00000100:00100000:3.0:1787852975.423558:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 133 00000100:00100000:3.0:1787852975.423589:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4904f51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af755b38-4932-400a-92cc-ddad0ca077a5+10:2362:x1874699526082560:12345-192.168.204.1@tcp:400: 00000100:00100000:3.0:1787852975.423680:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4904f51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af755b38-4932-400a-92cc-ddad0ca077a5+10:2362:x1874699526082560:12345-192.168.204.1@tcp:400: Request processed in 113us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1787852975.423688:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 133 00000100:00100000:3.0:1787852975.423796:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526082944 00000100:00100000:3.0:1787852975.423801:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526082944 00000100:00100000:3.0:1787852975.423843:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526082816 00000100:00100000:3.0:1787852975.423852:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526082816 00000100:00100000:3.0:1787852975.423874:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 16 00000100:00100000:3.0:1787852975.423881:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4910d10b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+5:2362:x1874699526082944:12345-192.168.204.1@tcp:400: 00000100:00100000:0.0:1787852975.423906:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526082688 00000100:00100000:0.0:1787852975.423910:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526082688 00000100:00100000:3.0:1787852975.423911:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4910d10b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+5:2362:x1874699526082944:12345-192.168.204.1@tcp:400: Request processed in 31us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1787852975.423917:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 16 00000100:00100000:3.0:1787852975.423927:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 17 00000100:00100000:3.0:1787852975.423933:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4910d121c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+5:2362:x1874699526082816:12345-192.168.204.1@tcp:400: 00000100:00100000:0.0:1787852975.423943:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 32 00000100:00100000:0.0:1787852975.423950:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4910d10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+6:2362:x1874699526082688:12345-192.168.204.1@tcp:400: 00000100:00100000:3.0:1787852975.423955:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4910d121c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+5:2362:x1874699526082816:12345-192.168.204.1@tcp:400: Request processed in 23us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1787852975.423961:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 17 00000100:00080000:3.0:1787852975.424103:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787852975.424108:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787852975.424110:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787852975.424909:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4910d10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+6:2362:x1874699526082688:12345-192.168.204.1@tcp:400: Request processed in 954us (1566us total) trans 0 rc 0/0 00000100:00100000:0.0:1787852975.424918:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 32 00010000:00010000:3.0:1787852975.919421:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787852976.857437:0:8444:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffff9a3a250 20000000:00000080:1.0:1787852976.857455:0:8444:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8f493c7e5400 uarg=0000000000000000 20000000:01000000:1.0:1787852976.857493:0:8444:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:1.0:1787852976.857495:0:8444:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:1.0:1787852976.857498:0:8444:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:1.0:1787852976.857503:0:8444:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:1.0:1787852976.857508:0:8444:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:1.0:1787852976.857523:0:8444:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787852976.857525:0:8444:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1787852976.857840:0:8444:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1787852976.857843:0:8444:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1787852976.858546:0:8445:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:1.0:1787852976.859161:0:8444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:1.0:1787852976.859236:0:8444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:1.0:1787852976.859276:0:8444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:1.0:1787852976.859288:0:8444:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1787852976.859290:0:8444:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1787852976.860985:0:8446:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:1.0:1787852976.861395:0:8444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:1.0:1787852976.861443:0:8444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:1.0:1787852976.861509:0:8444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:1.0:1787852976.861524:0:8444:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1787852976.861527:0:8444:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1787852976.862290:0:8447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:3.0:1787852976.863180:0:8444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:3.0:1787852976.863227:0:8444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:3.0:1787852976.863262:0:8444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:3.0:1787852976.863275:0:8444:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1787852976.863278:0:8444:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1787852976.864125:0:8448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:3.0:1787852976.864731:0:8444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:3.0:1787852976.864809:0:8444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:3.0:1787852976.864849:0:8444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 10000000:01000000:3.0:1787852976.864870:0:8444:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1787852976.864899:0:8444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f4921e21200/0x710df789068e6183 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852976.864924:0:8444:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f49421e2400/0x710df789068e6080 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x710df789068e6079 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852976.864949:0:8444:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f49421e3800/0x710df789068e60aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x710df789068e60a3 expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852976.864957:0:8444:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f49421e2c00/0x710df789068e60d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x710df789068e60cd expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852976.864964:0:8444:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f49029cc400/0x710df789068e60e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x710df789068e60db expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852976.864971:0:8444:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f49013fdc00/0x710df789068e60f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x710df789068e60e9 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852976.864978:0:8444:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f49421e3a00/0x710df789068e610c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x710df789068e6105 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852976.864985:0:8444:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f49421e3600/0x710df789068e6136 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x710df789068e612f expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852976.864995:0:8444:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f49029cc000/0x710df789068e6144 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c507938950e expref: 9 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852976.865004:0:8444:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f49013fd400/0x710df789068e614b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389515 expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852976.865014:0:8444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f4921e21200/0x710df789068e6183 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852976.865062:0:8444:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f49013fd400/0x710df789068e614b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389515 expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852976.865091:0:8444:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f49013fd400/0x710df789068e614b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389515 expref: 9 pid: 5831 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787852976.865109:0:8444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4910d13840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8444:1874699552321152:192.168.204.1@tcp:104: 00010000:00010000:3.0:1787852976.865245:0:8444:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f49029cc000/0x710df789068e6144 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.1@tcp remote: 0xd0a9c507938950e expref: 9 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852976.865254:0:8444:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f49029cc000/0x710df789068e6144 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c507938950e expref: 9 pid: 5830 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787852976.865263:0:8444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4910d103c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8444:1874699552321280:192.168.204.1@tcp:104: 00010000:00010000:3.0:1787852976.865296:0:8444:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f49421e3600/0x710df789068e6136 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x710df789068e612f expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852976.865304:0:8444:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f49421e3600/0x710df789068e6136 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x710df789068e612f expref: 18 pid: 5831 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787852976.865312:0:8444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4910d130c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8444:1874699552321408:0@lo:104: 00000100:00100000:3.0:1787852976.865357:0:8444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787852976.865750:0:8444:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f49421e3a00/0x710df789068e610c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x710df789068e6105 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852976.865759:0:8444:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f49421e3a00/0x710df789068e610c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x710df789068e6105 expref: 18 pid: 5830 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787852976.865767:0:8444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4910d11680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8444:1874699552321536:0@lo:104: 00010000:00010000:3.0:1787852976.865796:0:8444:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f49013fdc00/0x710df789068e60f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x710df789068e60e9 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852976.865811:0:8444:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f49013fdc00/0x710df789068e60f0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x710df789068e60e9 expref: 18 pid: 5830 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787852976.865820:0:8444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4910d12940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8444:1874699552321664:0@lo:104: 00010000:00010000:3.0:1787852976.865850:0:8444:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f49029cc400/0x710df789068e60e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x710df789068e60db expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852976.865860:0:8444:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f49029cc400/0x710df789068e60e2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x710df789068e60db expref: 18 pid: 5831 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787852976.865868:0:8444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4910d11e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8444:1874699552321792:0@lo:104: 00010000:00010000:3.0:1787852976.865891:0:8444:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f49421e2c00/0x710df789068e60d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x710df789068e60cd expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852976.865898:0:8444:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f49421e2c00/0x710df789068e60d4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x710df789068e60cd expref: 18 pid: 5829 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787852976.865907:0:8444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4910d12580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8444:1874699552321920:0@lo:104: 00010000:00010000:3.0:1787852976.865931:0:8444:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f49421e3800/0x710df789068e60aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x710df789068e60a3 expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852976.865939:0:8444:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f49421e3800/0x710df789068e60aa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x710df789068e60a3 expref: 18 pid: 5829 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787852976.865947:0:8444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4910d12d00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8444:1874699552322048:0@lo:104: 00010000:00010000:3.0:1787852976.865975:0:8444:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f49421e2400/0x710df789068e6080 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x710df789068e6079 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852976.865993:0:8444:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f49421e2400/0x710df789068e6080 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x710df789068e6079 expref: 18 pid: 5830 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787852976.866001:0:8444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4910d13480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8444:1874699552322176:0@lo:104: 00000100:00100000:3.0:1787852976.866021:0:8444:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f4908771f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787852976.866129:0:5820:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787852976.866154:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787852976.866189:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787852976.866220:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787852976.866224:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552321408 00000100:00100000:1.0:1787852976.866231:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787852976.866233:0:7630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552321408 00000100:00100000:1.0:1787852976.866246:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787852976.866247:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552321536 00000100:00100000:2.0:1787852976.866253:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552321536 00000100:00100000:1.0:1787852976.866259:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787852976.866270:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552321664 00000100:00100000:3.0:1787852976.866273:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552321920 00000100:00100000:2.0:1787852976.866273:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552321792 00000100:00100000:1.0:1787852976.866275:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552321664 00000100:00100000:2.0:1787852976.866278:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552321792 00000100:00100000:3.0:1787852976.866279:0:7630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552321920 00000100:00100000:3.0:1787852976.866301:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552322176 00000100:00100000:2.0:1787852976.866301:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552322048 00000100:00100000:3.0:1787852976.866304:0:7630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552322176 00000100:00100000:2.0:1787852976.866304:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552322048 00000100:00100000:1.0:1787852976.866319:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787852976.866336:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787852976.866341:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4801820850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5d48a955-7010-4118-9c7d-f396984ae1ff+9:8444:x1874699552321408:12345-0@lo:104: 00000100:00100000:3.0:1787852976.866348:0:7630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49079f12c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:5d48a955-7010-4118-9c7d-f396984ae1ff+9:8444:x1874699552321536:12345-0@lo:104: 00010000:00010000:1.0:1787852976.866359:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.101@tcp lock: ffff8f49421e2200/0x710df789068e612f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x710df789068e6136 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852976.866360:0:7630:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.101@tcp lock: ffff8f49421e2800/0x710df789068e6105 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x710df789068e610c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852976.866432:0:7630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787852976.866438:0:7630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49079f12c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:5d48a955-7010-4118-9c7d-f396984ae1ff+9:8444:x1874699552321536:12345-0@lo:104: Request processed in 96us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1787852976.866445:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787852976.866462:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787852976.866543:0:7630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49079f1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:5d48a955-7010-4118-9c7d-f396984ae1ff+8:8444:x1874699552321920:12345-0@lo:104: 00010000:00010000:3.0:1787852976.866552:0:7630:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.101@tcp lock: ffff8f49029cd600/0x710df789068e60cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x710df789068e60d4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852976.866589:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787852976.866596:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.101@tcp lock: ffff8f49421e2800/0x710df789068e6105 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x710df789068e610c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852976.866605:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49421e2800 already unused, calling callback (ffffffffc1b55c20) 10000000:00010000:0.0:1787852976.866610:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.101@tcp lock: ffff8f49421e2800/0x710df789068e6105 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x710df789068e610c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852976.866619:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.101@tcp lock: ffff8f49421e2800/0x710df789068e6105 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x710df789068e610c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787852976.866626:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.101@tcp lock: ffff8f49421e2800/0x710df789068e6105 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x710df789068e610c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852976.866627:0:7630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787852976.866633:0:7630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49079f1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:5d48a955-7010-4118-9c7d-f396984ae1ff+8:8444:x1874699552321920:12345-0@lo:104: Request processed in 164us (401us total) trans 0 rc 0/0 10000000:01000000:0.0:1787852976.866633:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787852976.866644:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787852976.866645:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787852976.866655:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4801820850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5d48a955-7010-4118-9c7d-f396984ae1ff+8:8444:x1874699552321408:12345-0@lo:104: Request processed in 318us (1297us total) trans 0 rc 0/0 00010000:00010000:0.0:1787852976.866663:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.101@tcp lock: ffff8f49421e2800/0x710df789068e6105 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x710df789068e610c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787852976.866664:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787852976.866670:0:7630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49079f2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:5d48a955-7010-4118-9c7d-f396984ae1ff+7:8444:x1874699552321792:12345-0@lo:104: 00000100:00100000:1.0:1787852976.866675:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:3.0:1787852976.866677:0:7630:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.101@tcp lock: ffff8f49029cde00/0x710df789068e60db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x710df789068e60e2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852976.866677:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787852976.866700:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.101@tcp lock: ffff8f49421e2800/0x710df789068e6105 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x710df789068e610c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852976.866706:0:7630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00010000:00010000:0.0:1787852976.866708:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.101@tcp lock: ffff8f49421e2800/0x710df789068e6105 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x710df789068e610c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787852976.866711:0:7630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49079f2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:5d48a955-7010-4118-9c7d-f396984ae1ff+6:8444:x1874699552321792:12345-0@lo:104: Request processed in 41us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1787852976.866718:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:0.0:1787852976.866723:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787852976.866727:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.101@tcp lock: ffff8f49029cd600/0x710df789068e60cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x710df789068e60d4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787852976.866732:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00010000:00010000:0.0:1787852976.866732:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49029cd600 already unused, calling callback (ffffffffc1b55c20) 00000100:00100000:3.0:1787852976.866753:0:7630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49079f3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:5d48a955-7010-4118-9c7d-f396984ae1ff+5:8444:x1874699552321664:12345-0@lo:104: 10000000:00010000:0.0:1787852976.866755:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.101@tcp lock: ffff8f49029cd600/0x710df789068e60cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x710df789068e60d4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852976.866760:0:7630:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.101@tcp lock: ffff8f49013fc000/0x710df789068e60e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x710df789068e60f0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852976.866762:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.101@tcp lock: ffff8f49029cd600/0x710df789068e60cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x710df789068e60d4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787852976.866768:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.101@tcp lock: ffff8f49029cd600/0x710df789068e60cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x710df789068e60d4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787852976.866773:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787852976.866783:0:7630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00010000:00010000:0.0:1787852976.866785:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.101@tcp lock: ffff8f49029cd600/0x710df789068e60cd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x710df789068e60d4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787852976.866788:0:7630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49079f3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:5d48a955-7010-4118-9c7d-f396984ae1ff+5:8444:x1874699552321664:12345-0@lo:104: Request processed in 51us (600us total) trans 0 rc 0/0 00010000:00010000:0.0:1787852976.866792:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1787852976.866794:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:0.0:1787852976.866796:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.101@tcp lock: ffff8f49029cd600/0x710df789068e60cd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x710df789068e60d4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852976.866802:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.101@tcp lock: ffff8f49029cd600/0x710df789068e60cd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x710df789068e60d4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787852976.866805:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787852976.866810:0:7630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49079f30c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:5d48a955-7010-4118-9c7d-f396984ae1ff+4:8444:x1874699552322176:12345-0@lo:104: 00010000:00010000:0.0:1787852976.866813:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787852976.866816:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.101@tcp lock: ffff8f49421e2200/0x710df789068e612f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x710df789068e6136 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852976.866817:0:7630:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.101@tcp lock: ffff8f49013fd200/0x710df789068e6079 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x710df789068e6080 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852976.866822:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49421e2200 already unused, calling callback (ffffffffc1b55c20) 10000000:00010000:0.0:1787852976.866825:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.101@tcp lock: ffff8f49421e2200/0x710df789068e612f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x710df789068e6136 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852976.866831:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.101@tcp lock: ffff8f49421e2200/0x710df789068e612f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x710df789068e6136 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852976.866838:0:7630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1787852976.866843:0:7630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49079f30c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:5d48a955-7010-4118-9c7d-f396984ae1ff+4:8444:x1874699552322176:12345-0@lo:104: Request processed in 33us (585us total) trans 0 rc 0/0 10000000:00010000:0.0:1787852976.866849:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.101@tcp lock: ffff8f49421e2200/0x710df789068e612f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x710df789068e6136 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787852976.866853:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 10000000:01000000:0.0:1787852976.866864:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1787852976.866865:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787852976.866868:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49079f1680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5d48a955-7010-4118-9c7d-f396984ae1ff+4:8444:x1874699552322048:12345-0@lo:104: 00010000:00010000:1.0:1787852976.866880:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.101@tcp lock: ffff8f4900031600/0x710df789068e60a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x710df789068e60aa expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852976.866881:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.101@tcp lock: ffff8f49421e2200/0x710df789068e612f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x710df789068e6136 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852976.866883:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787852976.866897:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787852976.866911:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.101@tcp lock: ffff8f49421e2200/0x710df789068e612f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x710df789068e6136 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852976.866919:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.101@tcp lock: ffff8f49421e2200/0x710df789068e612f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x710df789068e6136 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787852976.866929:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f494159e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5d48a955-7010-4118-9c7d-f396984ae1ff:3306:1874699552322560:0@lo:103: 00010000:00010000:0.0:1787852976.866930:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787852976.866932:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:0.0:1787852976.866934:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.101@tcp lock: ffff8f49013fc000/0x710df789068e60e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x710df789068e60f0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852976.866945:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49013fc000 already unused, calling callback (ffffffffc1b55c20) 10000000:00010000:0.0:1787852976.866948:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.101@tcp lock: ffff8f49013fc000/0x710df789068e60e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x710df789068e60f0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852976.866955:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.101@tcp lock: ffff8f49013fc000/0x710df789068e60e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x710df789068e60f0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787852976.866961:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.101@tcp lock: ffff8f49013fc000/0x710df789068e60e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x710df789068e60f0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787852976.866965:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787852976.866985:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.101@tcp lock: ffff8f49013fc000/0x710df789068e60e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x710df789068e60f0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852976.866991:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787852976.866996:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.101@tcp lock: ffff8f49013fc000/0x710df789068e60e9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x710df789068e60f0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852976.867003:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.101@tcp lock: ffff8f49013fc000/0x710df789068e60e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x710df789068e60f0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852976.867013:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787852976.867016:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.101@tcp lock: ffff8f49013fd200/0x710df789068e6079 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x710df789068e6080 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852976.867021:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49013fd200 already unused, calling callback (ffffffffc1b55c20) 10000000:00010000:0.0:1787852976.867024:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.101@tcp lock: ffff8f49013fd200/0x710df789068e6079 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x710df789068e6080 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852976.867030:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.101@tcp lock: ffff8f49013fd200/0x710df789068e6079 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x710df789068e6080 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787852976.867036:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.101@tcp lock: ffff8f49013fd200/0x710df789068e6079 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x710df789068e6080 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787852976.867038:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:0.0:1787852976.867041:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787852976.867052:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.101@tcp lock: ffff8f49013fd200/0x710df789068e6079 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x710df789068e6080 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852976.867058:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787852976.867061:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.101@tcp lock: ffff8f49013fd200/0x710df789068e6079 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x710df789068e6080 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787852976.867067:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787852976.867072:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f494159f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5d48a955-7010-4118-9c7d-f396984ae1ff:3306:1874699552322688:0@lo:103: 00000100:00100000:1.0:1787852976.867074:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49079f1680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5d48a955-7010-4118-9c7d-f396984ae1ff+3:8444:x1874699552322048:12345-0@lo:104: Request processed in 78us (696us total) trans 0 rc 0/0 00010000:00010000:0.0:1787852976.867076:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.101@tcp lock: ffff8f49013fd200/0x710df789068e6079 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x710df789068e6080 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787852976.867090:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00010000:0.0:1787852976.867093:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787852976.867098:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.101@tcp lock: ffff8f4900031600/0x710df789068e60a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x710df789068e60aa expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852976.867103:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4900031600 already unused, calling callback (ffffffffc1b55c20) 10000000:00010000:0.0:1787852976.867107:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.101@tcp lock: ffff8f4900031600/0x710df789068e60a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x710df789068e60aa expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852976.867114:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.101@tcp lock: ffff8f4900031600/0x710df789068e60a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x710df789068e60aa expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787852976.867119:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f494159c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5d48a955-7010-4118-9c7d-f396984ae1ff:3308:1874699552322304:0@lo:103: 10000000:00010000:0.0:1787852976.867122:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.101@tcp lock: ffff8f4900031600/0x710df789068e60a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x710df789068e60aa expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787852976.867130:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787852976.867154:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.101@tcp lock: ffff8f4900031600/0x710df789068e60a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x710df789068e60aa expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852976.867163:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787852976.867168:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.101@tcp lock: ffff8f4900031600/0x710df789068e60a3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x710df789068e60aa expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852976.867174:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.101@tcp lock: ffff8f4900031600/0x710df789068e60a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x710df789068e60aa expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852976.867185:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787852976.867192:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787852976.867194:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787852976.867214:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f494159cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5d48a955-7010-4118-9c7d-f396984ae1ff:3309:1874699552322432:0@lo:103: 00000100:00100000:1.0:1787852976.867284:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787852976.867318:0:8444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4910d130c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8444:1874699552321408:0@lo:104: 00000100:00100000:1.0:1787852976.867318:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f494159c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5d48a955-7010-4118-9c7d-f396984ae1ff:3308:1874699552322816:0@lo:103: 00000100:00100000:2.0:1787852976.867336:0:8444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4910d11680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8444:1874699552321536:0@lo:104: 00000100:00100000:2.0:1787852976.867346:0:8444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4910d12940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8444:1874699552321664:0@lo:104: 00000100:00100000:1.0:1787852976.867353:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787852976.867357:0:8444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4910d11e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8444:1874699552321792:0@lo:104: 00000100:00100000:2.0:1787852976.867364:0:8444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4910d12580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8444:1874699552321920:0@lo:104: 00000100:00100000:2.0:1787852976.867370:0:8444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4910d12d00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8444:1874699552322048:0@lo:104: 00000100:00100000:2.0:1787852976.867376:0:8444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4910d13480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8444:1874699552322176:0@lo:104: 00000100:00100000:1.0:1787852976.867529:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552322560 00000100:00100000:1.0:1787852976.867536:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552322560 00010000:00010000:1.0:1787852976.867558:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f49421e3600/0x710df789068e6136 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x710df789068e612f expref: 19 pid: 5831 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787852976.867606:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552322304 00000100:00100000:1.0:1787852976.867610:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552322304 00010000:00010000:1.0:1787852976.867630:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f49421e3a00/0x710df789068e610c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x710df789068e6105 expref: 20 pid: 5830 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787852976.867645:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552322816 00000100:00100000:1.0:1787852976.867648:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552322816 00010000:00010000:1.0:1787852976.867658:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f49421e2400/0x710df789068e6080 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x710df789068e6079 expref: 21 pid: 5830 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787852976.867671:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787852976.867677:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f491e973450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5d48a955-7010-4118-9c7d-f396984ae1ff+21:3306:x1874699552322560:12345-0@lo:103: 00010000:00010000:1.0:1787852976.867688:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787852976.867701:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f49421e3600/0x710df789068e6136 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x710df789068e612f expref: 21 pid: 5831 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852976.867713:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f49421e3600/0x710df789068e6136 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x710df789068e612f expref: 21 pid: 5831 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852976.867730:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f49421e3600/0x710df789068e6136 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x710df789068e612f expref: 21 pid: 5831 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852976.867850:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787852976.867877:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f491e973450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5d48a955-7010-4118-9c7d-f396984ae1ff+20:3306:x1874699552322560:12345-0@lo:103: Request processed in 201us (839us total) trans 0 rc 0/0 00000100:00100000:1.0:1787852976.867885:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787852976.868079:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787852976.868087:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49079f2940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5d48a955-7010-4118-9c7d-f396984ae1ff+19:3308:x1874699552322304:12345-0@lo:103: 00010000:00010000:1.0:1787852976.868095:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787852976.868100:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f49421e3a00/0x710df789068e610c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x710df789068e6105 expref: 19 pid: 5830 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852976.868119:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f49421e3a00/0x710df789068e610c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x710df789068e6105 expref: 19 pid: 5830 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852976.868131:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f49421e3a00/0x710df789068e610c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x710df789068e6105 expref: 19 pid: 5830 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852976.868141:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787852976.868250:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49079f2940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5d48a955-7010-4118-9c7d-f396984ae1ff+18:3308:x1874699552322304:12345-0@lo:103: Request processed in 89us (892us total) trans 0 rc 0/0 00000100:00100000:1.0:1787852976.868258:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787852976.868279:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787852976.868283:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787852976.868291:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49079f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5d48a955-7010-4118-9c7d-f396984ae1ff+17:3308:x1874699552322816:12345-0@lo:103: 00010000:00010000:1.0:1787852976.868301:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787852976.868307:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f49421e2400/0x710df789068e6080 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x710df789068e6079 expref: 17 pid: 5830 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852976.868317:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f49421e2400/0x710df789068e6080 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x710df789068e6079 expref: 17 pid: 5830 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787852976.868325:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f494159e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5d48a955-7010-4118-9c7d-f396984ae1ff:3306:1874699552322560:0@lo:103: 00010000:00010000:1.0:1787852976.868329:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f49421e2400/0x710df789068e6080 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x710df789068e6079 expref: 17 pid: 5830 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852976.868342:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787852976.868366:0:5822:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1787852976.868375:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:0.0:1787852976.868448:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787852976.868461:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49079f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5d48a955-7010-4118-9c7d-f396984ae1ff+16:3308:x1874699552322816:12345-0@lo:103: Request processed in 172us (1107us total) trans 0 rc 0/0 00000100:00100000:1.0:1787852976.868469:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787852976.868483:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552322688 00000100:00100000:0.0:1787852976.868485:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f494159f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5d48a955-7010-4118-9c7d-f396984ae1ff:3309:1874699552322944:0@lo:103: 00000100:00100000:1.0:1787852976.868489:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552322688 00010000:00010000:1.0:1787852976.868516:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f49013fdc00/0x710df789068e60f0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x710df789068e60e9 expref: 16 pid: 5830 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787852976.868521:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787852976.868538:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552322432 00000100:00100000:1.0:1787852976.868541:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552322432 00010000:00010000:1.0:1787852976.868553:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f49421e2c00/0x710df789068e60d4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x710df789068e60cd expref: 17 pid: 5829 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787852976.868563:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552322944 00000100:00100000:1.0:1787852976.868566:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552322944 00010000:00010000:1.0:1787852976.868601:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f49421e3800/0x710df789068e60aa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x710df789068e60a3 expref: 18 pid: 5829 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787852976.868615:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787852976.868622:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4910d13c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5d48a955-7010-4118-9c7d-f396984ae1ff+18:3306:x1874699552322688:12345-0@lo:103: 00010000:00010000:1.0:1787852976.868631:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787852976.868635:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f49013fdc00/0x710df789068e60f0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x710df789068e60e9 expref: 18 pid: 5830 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852976.868644:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f49013fdc00/0x710df789068e60f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x710df789068e60e9 expref: 18 pid: 5830 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852976.868656:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f49013fdc00/0x710df789068e60f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x710df789068e60e9 expref: 18 pid: 5830 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852976.868667:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787852976.868697:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4910d13c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5d48a955-7010-4118-9c7d-f396984ae1ff+17:3306:x1874699552322688:12345-0@lo:103: Request processed in 75us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1787852976.868704:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787852976.868717:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787852976.868724:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f494159d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5d48a955-7010-4118-9c7d-f396984ae1ff+16:3309:x1874699552322432:12345-0@lo:103: 00010000:00010000:1.0:1787852976.868752:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787852976.868757:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f49421e2c00/0x710df789068e60d4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x710df789068e60cd expref: 16 pid: 5829 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852976.868767:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f49421e2c00/0x710df789068e60d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x710df789068e60cd expref: 16 pid: 5829 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852976.868779:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f49421e2c00/0x710df789068e60d4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x710df789068e60cd expref: 16 pid: 5829 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852976.868790:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787852976.868803:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f494159c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5d48a955-7010-4118-9c7d-f396984ae1ff:3308:1874699552322304:0@lo:103: 00000100:00100000:2.0:1787852976.868816:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f494159c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5d48a955-7010-4118-9c7d-f396984ae1ff:3308:1874699552322816:0@lo:103: 00000100:00100000:1.0:1787852976.868829:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f494159d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5d48a955-7010-4118-9c7d-f396984ae1ff+15:3309:x1874699552322432:12345-0@lo:103: Request processed in 105us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1787852976.868837:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787852976.868841:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f494159cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5d48a955-7010-4118-9c7d-f396984ae1ff:3309:1874699552322432:0@lo:103: 00000100:00100000:1.0:1787852976.868858:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787852976.868865:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f494159e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5d48a955-7010-4118-9c7d-f396984ae1ff+14:3309:x1874699552322944:12345-0@lo:103: 00010000:00010000:1.0:1787852976.868873:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787852976.868877:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f49421e3800/0x710df789068e60aa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x710df789068e60a3 expref: 14 pid: 5829 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852976.868885:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f49421e3800/0x710df789068e60aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x710df789068e60a3 expref: 14 pid: 5829 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852976.868896:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f49421e3800/0x710df789068e60aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x710df789068e60a3 expref: 14 pid: 5829 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852976.868905:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787852976.868935:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f494159e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5d48a955-7010-4118-9c7d-f396984ae1ff+13:3309:x1874699552322944:12345-0@lo:103: Request processed in 71us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1787852976.868941:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787852976.869019:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f494159f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5d48a955-7010-4118-9c7d-f396984ae1ff:3306:1874699552322688:0@lo:103: 00000100:00100000:0.0:1787852976.869274:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f494159f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5d48a955-7010-4118-9c7d-f396984ae1ff:3309:1874699552322944:0@lo:103: 00010000:00010000:2.0:1787852976.869407:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787852976.869453:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787852976.869455:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787852976.869520:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.101@tcp lock: ffff8f49029cde00/0x710df789068e60db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x710df789068e60e2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852976.869530:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49029cde00 already unused, calling callback (ffffffffc1b55c20) 10000000:00010000:3.0:1787852976.869534:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.101@tcp lock: ffff8f49029cde00/0x710df789068e60db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x710df789068e60e2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852976.869543:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.101@tcp lock: ffff8f49029cde00/0x710df789068e60db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x710df789068e60e2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787852976.869550:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.101@tcp lock: ffff8f49029cde00/0x710df789068e60db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x710df789068e60e2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787852976.869555:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787852976.869680:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.101@tcp lock: ffff8f49029cde00/0x710df789068e60db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x710df789068e60e2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852976.869700:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1787852976.869751:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4910d10780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5d48a955-7010-4118-9c7d-f396984ae1ff:3306:1874699552323072:0@lo:103: 00000100:00100000:2.0:1787852976.869795:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787852976.869857:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.101@tcp lock: ffff8f49029cde00/0x710df789068e60db lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x710df789068e60e2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852976.869865:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.101@tcp lock: ffff8f49029cde00/0x710df789068e60db lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x710df789068e60e2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852976.869885:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787852976.869887:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787852976.869890:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787852976.870627:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552323072 00000100:00100000:0.0:1787852976.870635:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552323072 00010000:00010000:0.0:1787852976.870663:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f49029cc400/0x710df789068e60e2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x710df789068e60db expref: 13 pid: 5831 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787852976.870696:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787852976.870704:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49415a6d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5d48a955-7010-4118-9c7d-f396984ae1ff+13:3306:x1874699552323072:12345-0@lo:103: 00010000:00010000:0.0:1787852976.870717:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787852976.870721:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f49029cc400/0x710df789068e60e2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x710df789068e60db expref: 13 pid: 5831 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852976.870731:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f49029cc400/0x710df789068e60e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x710df789068e60db expref: 13 pid: 5831 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852976.870759:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f49029cc400/0x710df789068e60e2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x710df789068e60db expref: 13 pid: 5831 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852976.870772:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787852976.870822:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49415a6d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5d48a955-7010-4118-9c7d-f396984ae1ff+12:3306:x1874699552323072:12345-0@lo:103: Request processed in 119us (1027us total) trans 0 rc 0/0 00000100:00100000:0.0:1787852976.870837:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787852976.870889:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4910d10780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5d48a955-7010-4118-9c7d-f396984ae1ff:3306:1874699552323072:0@lo:103: 00000100:00100000:3.0:1787852976.874772:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787852976.874812:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787852976.874869:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526083072 00000100:00100000:0.0:1787852976.874875:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526083200 00000100:00100000:1.0:1787852976.874883:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526083072 00000100:00100000:0.0:1787852976.874884:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526083200 00010000:00010000:0.0:1787852976.874937:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f49029cc000/0x710df789068e6144 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c507938950e expref: 11 pid: 5830 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787852976.874995:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 19 00000100:00100000:0.0:1787852976.875009:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4910d10780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af755b38-4932-400a-92cc-ddad0ca077a5+11:2362:x1874699526083200:12345-192.168.204.1@tcp:103: 00010000:00010000:0.0:1787852976.875030:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787852976.875037:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f49029cc000/0x710df789068e6144 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c507938950e expref: 11 pid: 5830 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852976.875050:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f49029cc000/0x710df789068e6144 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c507938950e expref: 11 pid: 5830 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852976.875058:0:8450:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f49013fd400/0x710df789068e614b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389515 expref: 11 pid: 5831 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852976.875079:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787852976.875098:0:8444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4910d13840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8444:1874699552321152:192.168.204.1@tcp:104: 00000100:00100000:1.0:1787852976.875098:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 20 00000100:00100000:1.0:1787852976.875110:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f491e973c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:af755b38-4932-400a-92cc-ddad0ca077a5+11:2363:x1874699526083072:12345-192.168.204.1@tcp:103: 00010000:00010000:1.0:1787852976.875124:0:8450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787852976.875129:0:8450:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f49013fd400/0x710df789068e614b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389515 expref: 11 pid: 5831 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852976.875144:0:8450:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f49013fd400/0x710df789068e614b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389515 expref: 11 pid: 5831 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787852976.875155:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4910d10780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af755b38-4932-400a-92cc-ddad0ca077a5+11:2362:x1874699526083200:12345-192.168.204.1@tcp:103: Request processed in 149us (340us total) trans 0 rc 0/0 00010000:00010000:1.0:1787852976.875160:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f49013fd400/0x710df789068e614b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389515 expref: 11 pid: 5831 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787852976.875170:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 19 00010000:00010000:1.0:1787852976.875255:0:8450:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f4921e21200/0x710df789068e6183 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852976.875268:0:8450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f4921e21200/0x710df789068e6183 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852976.875288:0:8450:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f4921e21200/0x710df789068e6183 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852976.875296:0:8450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f4921e21200/0x710df789068e6183 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852976.875304:0:8450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f4921e21200/0x710df789068e6183 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852976.875330:0:8450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f4921e21200/0x710df789068e6183 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852976.875338:0:8450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4921e21200 already unused, calling callback (ffffffffc1528440) 00010000:00010000:1.0:1787852976.875344:0:8450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f4921e21200/0x710df789068e6183 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852976.875353:0:8450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f4921e21200/0x710df789068e6183 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852976.875364:0:8450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f4921e21200/0x710df789068e6183 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852976.875375:0:8450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787852976.875716:0:8444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f49029cc000/0x710df789068e6144 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c507938950e expref: 9 pid: 5830 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787852976.875733:0:8444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4910d103c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8444:1874699552321280:192.168.204.1@tcp:104: 00000100:00100000:1.0:1787852976.875807:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f491e973c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:af755b38-4932-400a-92cc-ddad0ca077a5+8:2363:x1874699526083072:12345-192.168.204.1@tcp:103: Request processed in 698us (1068us total) trans 0 rc 0/0 00000100:00100000:1.0:1787852976.875818:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 20 00010000:00010000:2.0:1787852976.875869:0:8444:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f4921e21200/0x710df789068e6183 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787852976.875882:0:8444:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f4921e21200/0x710df789068e6183 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787852976.875889:0:8444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f4921e21200/0x710df789068e6183 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787852976.875896:0:8444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f4921e21200/0x710df789068e6183 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852976.938763:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787852977.897992:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4910d112c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5d48a955-7010-4118-9c7d-f396984ae1ff:3307:1874699552323200:0@lo:400: 00000100:00100000:1.0:1787852977.897992:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4910d10f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874699552323328:0@lo:400: 00000100:00100000:3.0:1787852977.902640:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4910d103c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1874699552323584:0@lo:400: 00000100:00100000:1.0:1787852977.902747:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787852977.902792:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552323328 00000100:00100000:3.0:1787852977.902800:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552323328 00000100:00100000:1.0:1787852977.902833:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4910d13c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874699552323840:0@lo:400: 00000100:00100000:3.0:1787852977.902856:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787852977.902869:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49079f2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874699552323328:12345-0@lo:400: 00000100:00100000:1.0:1787852977.902870:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787852977.902917:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49079f2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874699552323328:12345-0@lo:400: Request processed in 53us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1787852977.902924:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787852977.902990:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4910d10f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874699552323328:0@lo:400: 00000100:00100000:0.0:1787852977.902997:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4910d11a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874699552323456:0@lo:400: 00000100:00100000:1.0:1787852977.903028:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787852977.903034:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787852977.903052:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787852977.903060:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4910d13840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1874699552323712:0@lo:400: 00000100:00100000:1.0:1787852977.903085:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787852977.907432:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552323584 00000100:00100000:1.0:1787852977.907464:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552323584 00000100:00100000:1.0:1787852977.907520:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552323712 00000100:00100000:1.0:1787852977.907523:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552323712 00000100:00100000:1.0:1787852977.907543:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787852977.907550:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49079f0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874699552323584:12345-0@lo:400: 00000100:00080000:0.0:1787852977.907966:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787852977.908002:0:5837:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1787852977.908013:0:5837:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1787852977.908123:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787852977.908133:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49079f2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874699552323712:12345-0@lo:400: 00000100:00100000:0.0:1787852977.908201:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49079f2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874699552323712:12345-0@lo:400: Request processed in 70us (5114us total) trans 0 rc 0/0 00000100:00100000:0.0:1787852977.908217:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787852977.908397:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4910d13840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1874699552323712:0@lo:400: 00000100:00100000:1.0:1787852977.908507:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49079f0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874699552323584:12345-0@lo:400: Request processed in 955us (5478us total) trans 0 rc 0/0 00000100:00100000:1.0:1787852977.908514:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787852977.908545:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4910d103c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1874699552323584:0@lo:400: 00000100:00100000:2.0:1787852977.908889:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787852977.908991:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552323200 00000100:00100000:1.0:1787852977.908996:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552323200 00000100:00100000:1.0:1787852977.909034:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1787852977.909041:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4904f52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+12:3307:x1874699552323200:12345-0@lo:400: 00000100:00100000:1.0:1787852977.909079:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4904f52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+12:3307:x1874699552323200:12345-0@lo:400: Request processed in 38us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1787852977.909085:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1787852977.909187:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4910d112c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5d48a955-7010-4118-9c7d-f396984ae1ff:3307:1874699552323200:0@lo:400: 00000100:00100000:0.0:1787852977.909921:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552323840 00000100:00100000:0.0:1787852977.909929:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552323840 00000100:00100000:0.0:1787852977.909971:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552323456 00000100:00100000:0.0:1787852977.909975:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552323456 00000100:00080000:1.0:1787852977.909990:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787852977.909997:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787852977.909997:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787852977.910010:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49079f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1874699552323840:12345-0@lo:400: 00000100:00100000:2.0:1787852977.910020:0:6681:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1787852977.910031:0:6681:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1787852977.910084:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49079f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1874699552323840:12345-0@lo:400: Request processed in 77us (7216us total) trans 0 rc 0/0 00000100:00100000:0.0:1787852977.910092:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787852977.910108:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787852977.910116:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f494159f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1874699552323456:12345-0@lo:400: 00000100:00100000:0.0:1787852977.910168:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f494159f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1874699552323456:12345-0@lo:400: Request processed in 53us (7134us total) trans 0 rc 0/0 00000100:00100000:0.0:1787852977.910176:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:1.0:1787852977.910200:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f4910d11a40 x1874699552323456/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787852993 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1787852977.910203:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f4910d13c00 x1874699552323840/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787852993 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787852977.910237:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4910d13c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874699552323840:0@lo:400: 00000100:00100000:1.0:1787852977.910238:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4910d11a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874699552323456:0@lo:400: 00010000:00010000:2.0:1787852977.961880:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787852978.410862:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787852978.410888:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49415a6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874699552323968:0@lo:13: 00000100:00100000:2.0:1787852978.411062:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787852978.413939:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552323968 00000100:00100000:3.0:1787852978.413955:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552323968 00000100:00100000:3.0:1787852978.414045:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787852978.414057:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49415a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874699552323968:12345-0@lo:13: 00002000:00000024:3.0:1787852978.414100:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787852978.414207:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49415a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874699552323968:12345-0@lo:13: Request processed in 152us (3234us total) trans 0 rc 0/0 00000100:00100000:3.0:1787852978.414215:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:3.0:1787852978.414407:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f49415a6580 x1874699552323968/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787852994 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787852978.414427:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49415a6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874699552323968:0@lo:13: 00000100:00100000:2.0:1787852978.415864:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f494159cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552324096:0@lo:13: 00000100:00100000:2.0:1787852978.415934:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787852978.416066:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552324096 00000100:00100000:0.0:1787852978.416074:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552324096 00000100:00100000:0.0:1787852978.416125:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787852978.416133:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49415a6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874699552324096:12345-0@lo:13: 00002000:00000024:0.0:1787852978.416166:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787852978.416206:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49415a6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874699552324096:12345-0@lo:13: Request processed in 74us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1787852978.416213:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:2.0:1787852978.417654:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f494159cb40 x1874699552324096/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787852994 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787852978.417698:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f494159cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552324096:0@lo:13: 10000000:01000000:0.0:1787852978.473852:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787852978.473863:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8f493dc01800 from 39 10000000:01000000:0.0:1787852978.473869:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787852978.473949:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f4900031e00/0x710df789068e618a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852978.473961:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.101@tcp lock: ffff8f4900031e00/0x710df789068e618a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852978.473973:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: ffff8f4900031e00/0x710df789068e618a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787852978.474014:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f494159cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552324224:0@lo:101: 00000100:00100000:0.0:1787852978.474108:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787852978.474177:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f492a8a2f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787852978.474744:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552324224 00000100:00100000:3.0:1787852978.474754:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552324224 00000100:00100000:3.0:1787852978.474817:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1787852978.474827:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4904f53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+12:5834:x1874699552324224:12345-0@lo:101: 00010000:00010000:3.0:1787852978.474842:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787852978.474858:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f4921e21e00/0x710df789068e6191 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x710df789068e618a expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852978.474883:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f4921e21e00/0x710df789068e6191 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x710df789068e618a expref: 13 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852978.474894:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f4921e21e00/0x710df789068e6191 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x710df789068e618a expref: 13 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852978.474903:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4921e21e00, rc 0) 00000100:00100000:3.0:1787852978.474949:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4904f53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+13:5834:x1874699552324224:12345-0@lo:101: Request processed in 124us (841us total) trans 0 rc 0/0 00000100:00100000:3.0:1787852978.474955:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1787852978.476274:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f494159cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552324224:0@lo:101: 00010000:00010000:0.0:1787852978.476304:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: ffff8f4900031e00/0x710df789068e618a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e6191 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852978.476315:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: ffff8f4900031e00/0x710df789068e618a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x710df789068e6191 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787852978.476393:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f494159cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552324352:0@lo:501: 00000100:00100000:0.0:1787852978.476525:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787852978.476606:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f492a8a2f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787852978.476688:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552324352 00000100:00100000:1.0:1787852978.476694:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552324352 00000100:00100000:1.0:1787852978.476749:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1787852978.476758:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4904f53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+13:5834:x1874699552324352:12345-0@lo:501: 00000100:00100000:1.0:1787852978.477056:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4904f53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+13:5834:x1874699552324352:12345-0@lo:501: Request processed in 298us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1787852978.477073:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1787852978.477307:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f494159cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552324352:0@lo:501: 00000100:00100000:0.0:1787852978.477337:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f494159cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552324480:0@lo:503: 00000100:00100000:0.0:1787852978.477373:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787852978.477398:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f492a8a2f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787852978.477517:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552324480 00000100:00100000:2.0:1787852978.477523:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552324480 00000100:00100000:2.0:1787852978.477565:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1787852978.477600:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4904f52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d48a955-7010-4118-9c7d-f396984ae1ff+13:5834:x1874699552324480:12345-0@lo:503: 00000100:00100000:2.0:1787852978.477750:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4904f52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d48a955-7010-4118-9c7d-f396984ae1ff+13:5834:x1874699552324480:12345-0@lo:503: Request processed in 179us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1787852978.477757:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1787852978.477873:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f494159cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552324480:0@lo:503: 00000100:00100000:3.0:1787852978.478285:0:8465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4910d13480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d48a955-7010-4118-9c7d-f396984ae1ff:8465:1874699552324608:0@lo:502: 00000100:00100000:3.0:1787852978.478325:0:8465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787852978.478356:0:8465:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f4910a81000 going to sleep for 11 seconds 00000100:00100000:1.0:1787852978.478412:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552324608 00000100:00100000:1.0:1787852978.478417:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552324608 00000100:00100000:1.0:1787852978.478514:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1787852978.478522:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4904f52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+13:8465:x1874699552324608:12345-0@lo:502: 00000100:00100000:1.0:1787852978.478874:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4904f52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+13:8465:x1874699552324608:12345-0@lo:502: Request processed in 353us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1787852978.478882:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1787852978.481750:0:8465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4910d13480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d48a955-7010-4118-9c7d-f396984ae1ff:8465:1874699552324608:0@lo:502: 00000100:00100000:3.0:1787852978.481869:0:8465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4910d13480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d48a955-7010-4118-9c7d-f396984ae1ff:8465:1874699552324736:0@lo:502: 00000100:00100000:3.0:1787852978.481953:0:8465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787852978.482215:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552324736 00000100:00100000:1.0:1787852978.482222:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552324736 00000100:00100000:1.0:1787852978.482274:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1787852978.482284:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4904f51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+13:8465:x1874699552324736:12345-0@lo:502: 00000100:00100000:3.0:1787852978.482778:0:8465:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f4906401a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787852978.486278:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4904f51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+13:8465:x1874699552324736:12345-0@lo:502: Request processed in 3985us (4314us total) trans 0 rc 0/0 00000100:00100000:1.0:1787852978.486296:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1787852978.486629:0:8465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4910d13480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d48a955-7010-4118-9c7d-f396984ae1ff:8465:1874699552324736:0@lo:502: 00000040:00080000:3.0:1787852978.486686:0:8465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1787852978.486947:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1787852978.486978:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787852978.486998:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f4900031e00/0x710df789068e618a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e6191 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852978.487008:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: ffff8f4900031e00/0x710df789068e618a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e6191 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787852978.487019:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1787852978.487022:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:0.0:1787852978.487025:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1787852978.487060:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f4900030e00/0x710df789068e6198 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852978.487067:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.101@tcp lock: ffff8f4900030e00/0x710df789068e6198 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852978.487075:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: ffff8f4900030e00/0x710df789068e6198 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787852978.487094:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f494159cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552324864:0@lo:101: 00000100:00100000:0.0:1787852978.487138:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787852978.487176:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f492a8a2f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787852978.487330:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552324864 00000100:00100000:2.0:1787852978.487337:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552324864 00000100:00100000:2.0:1787852978.487382:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1787852978.487391:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4904f50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d48a955-7010-4118-9c7d-f396984ae1ff+13:5834:x1874699552324864:12345-0@lo:101: 00010000:00010000:2.0:1787852978.487414:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787852978.487433:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f49415b9800/0x710df789068e619f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x710df789068e6198 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787852978.487458:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f49415b9800/0x710df789068e619f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x710df789068e6198 expref: 14 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787852978.487470:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f49415b9800/0x710df789068e619f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x710df789068e6198 expref: 14 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787852978.487480:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49415b9800, rc 0) 00000100:00100000:2.0:1787852978.487531:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4904f50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d48a955-7010-4118-9c7d-f396984ae1ff+14:5834:x1874699552324864:12345-0@lo:101: Request processed in 141us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1787852978.487537:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1787852978.487820:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f494159cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552324864:0@lo:101: 00010000:00010000:3.0:1787852978.487833:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: ffff8f4900030e00/0x710df789068e6198 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e619f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852978.487843:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: ffff8f4900030e00/0x710df789068e6198 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x710df789068e619f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787852978.487889:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4910d13480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552324992:0@lo:501: 00000100:00100000:3.0:1787852978.487919:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787852978.488338:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f4910a81000 going to sleep for 11 seconds 00000100:00100000:2.0:1787852978.498806:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552324992 00000100:00100000:2.0:1787852978.498847:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552324992 00000100:00100000:2.0:1787852978.498920:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1787852978.498930:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4904f50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+14:5834:x1874699552324992:12345-0@lo:501: 00000100:00100000:2.0:1787852978.499735:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4904f50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+14:5834:x1874699552324992:12345-0@lo:501: Request processed in 803us (11812us total) trans 0 rc 0/0 00000100:00100000:2.0:1787852978.499744:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1787852978.499851:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4910d13480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552324992:0@lo:501: 00000100:00100000:3.0:1787852978.499915:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4910d13480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552325120:0@lo:503: 00000100:00100000:3.0:1787852978.499978:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787852978.500032:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f4910a81000 going to sleep for 11 seconds 00000100:00100000:0.0:1787852978.500431:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552325120 00000100:00100000:0.0:1787852978.500438:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552325120 00000100:00100000:0.0:1787852978.500492:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1787852978.500500:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4904f50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+14:5834:x1874699552325120:12345-0@lo:503: 00000100:00100000:0.0:1787852978.501841:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4904f50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+14:5834:x1874699552325120:12345-0@lo:503: Request processed in 1332us (1854us total) trans 0 rc 0/0 00000100:00100000:0.0:1787852978.501853:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787852978.507097:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4910d13480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552325120:0@lo:503: 00000100:00100000:0.0:1787852978.510832:0:8466:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f494159d680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d48a955-7010-4118-9c7d-f396984ae1ff:8466:1874699552325248:0@lo:502: 00000100:00100000:0.0:1787852978.510942:0:8466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787852978.510996:0:8466:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f492a8a2cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787852978.512280:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552325248 00000100:00100000:2.0:1787852978.512292:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552325248 00000100:00100000:2.0:1787852978.512360:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1787852978.512370:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4904f53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+14:8466:x1874699552325248:12345-0@lo:502: 00000100:00100000:2.0:1787852978.512687:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4904f53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+14:8466:x1874699552325248:12345-0@lo:502: Request processed in 318us (1745us total) trans 0 rc 0/0 00000100:00100000:2.0:1787852978.512694:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1787852978.515737:0:8466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f494159d680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d48a955-7010-4118-9c7d-f396984ae1ff:8466:1874699552325248:0@lo:502: 00000020:01000000:0.0:1787852978.515787:0:8466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787852978.515800:0:8466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787852978.515803:0:8466:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787852978.515809:0:8466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1787852978.515848:0:8466:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f494159d680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d48a955-7010-4118-9c7d-f396984ae1ff:8466:1874699552325376:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787852978.515924:0:8466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787852978.515990:0:8466:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f492a8a2cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787852978.516641:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552325376 00000100:00100000:3.0:1787852978.516650:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552325376 00000100:00100000:3.0:1787852978.516920:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1787852978.516932:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4904f50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+14:8466:x1874699552325376:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787852978.517373:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4904f50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+14:8466:x1874699552325376:12345-0@lo:502:llog_process_th.0 Request processed in 443us (1447us total) trans 0 rc 0/0 00000100:00100000:3.0:1787852978.517390:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1787852978.519030:0:8466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f494159d680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d48a955-7010-4118-9c7d-f396984ae1ff:8466:1874699552325376:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787852978.519177:0:8466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787852978.519188:0:8466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787852978.519191:0:8466:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787852978.519197:0:8466:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:1.0:1787852978.519454:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:1.0:1787852978.519474:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.101@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1787852978.519485:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f4900030e00/0x710df789068e6198 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e619f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852978.519497:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: ffff8f4900030e00/0x710df789068e6198 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e619f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787852978.519508:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787852978.519511:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8f4903010800 from 39 10000000:01000000:1.0:1787852978.519513:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787852978.521363:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f492a8acc00/0x710df789068e61a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852978.521378:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.101@tcp lock: ffff8f492a8acc00/0x710df789068e61a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852978.521392:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: ffff8f492a8acc00/0x710df789068e61a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787852978.521421:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49079f0f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552325504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787852978.521496:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787852978.521614:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f4910a2c180 going to sleep for 11 seconds 00000100:00100000:2.0:1787852978.521724:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552325504 00000100:00100000:2.0:1787852978.521733:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552325504 00000100:00100000:2.0:1787852978.521787:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1787852978.521802:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4904f53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+14:5834:x1874699552325504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787852978.521817:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787852978.521830:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f49415b9000/0x710df789068e61ad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x710df789068e61a6 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787852978.521855:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f49415b9000/0x710df789068e61ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x710df789068e61a6 expref: 15 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787852978.521867:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f49415b9000/0x710df789068e61ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x710df789068e61a6 expref: 15 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787852978.521877:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49415b9000, rc 0) 00000100:00100000:2.0:1787852978.521949:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4904f53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+15:5834:x1874699552325504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 149us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1787852978.521957:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787852978.521980:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49079f0f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552325504:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787852978.522014:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: ffff8f492a8acc00/0x710df789068e61a6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e61ad expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852978.522025:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: ffff8f492a8acc00/0x710df789068e61a6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x710df789068e61ad expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787852978.522099:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49079f0f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552325632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787852978.522130:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787852978.522160:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f4910a2c180 going to sleep for 11 seconds 00000100:00100000:3.0:1787852978.522266:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552325632 00000100:00100000:3.0:1787852978.522271:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552325632 00000100:00100000:3.0:1787852978.522312:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1787852978.522322:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4904f51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+15:5834:x1874699552325632:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787852978.522628:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4904f51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+15:5834:x1874699552325632:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 308us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1787852978.522637:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787852978.523002:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49079f0f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552325632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787852978.523040:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49079f0f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552325760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787852978.523081:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787852978.523118:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f4910a2c180 going to sleep for 11 seconds 00000100:00100000:2.0:1787852978.524106:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552325760 00000100:00100000:2.0:1787852978.524115:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552325760 00000100:00100000:2.0:1787852978.524168:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1787852978.524178:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4904f52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d48a955-7010-4118-9c7d-f396984ae1ff+15:5834:x1874699552325760:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787852978.524411:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4904f52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d48a955-7010-4118-9c7d-f396984ae1ff+15:5834:x1874699552325760:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 235us (1328us total) trans 0 rc 0/0 00000100:00100000:2.0:1787852978.524419:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1787852978.526264:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49079f0f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552325760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787852978.528934:0:8467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49079f0f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d48a955-7010-4118-9c7d-f396984ae1ff:8467:1874699552325888:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787852978.529164:0:8467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787852978.529242:0:8467:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f493c04eb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787852978.529283:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552325888 00000100:00100000:0.0:1787852978.529290:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552325888 00000100:00100000:0.0:1787852978.529377:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1787852978.529387:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4904f51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+15:8467:x1874699552325888:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787852978.529691:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4904f51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+15:8467:x1874699552325888:12345-0@lo:502:llog_process_th.0 Request processed in 305us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1787852978.529700:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1787852978.529804:0:8467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49079f0f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d48a955-7010-4118-9c7d-f396984ae1ff:8467:1874699552325888:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787852978.529856:0:8467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49079f0f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d48a955-7010-4118-9c7d-f396984ae1ff:8467:1874699552326016:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787852978.529889:0:8467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787852978.530462:0:8467:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f493c04eb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787852978.530747:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552326016 00000100:00100000:2.0:1787852978.530755:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552326016 00000100:00100000:2.0:1787852978.530789:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787852978.530798:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4911c01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d48a955-7010-4118-9c7d-f396984ae1ff+15:8467:x1874699552326016:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787852978.531181:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4911c01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d48a955-7010-4118-9c7d-f396984ae1ff+15:8467:x1874699552326016:12345-0@lo:502:llog_process_th.0 Request processed in 382us (1289us total) trans 0 rc 0/0 00000100:00100000:2.0:1787852978.531189:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1787852978.531317:0:8467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49079f0f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d48a955-7010-4118-9c7d-f396984ae1ff:8467:1874699552326016:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1787852978.531348:0:8467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1787852978.531816:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1787852978.531836:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787852978.531847:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f492a8acc00/0x710df789068e61a6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e61ad expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852978.531858:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: ffff8f492a8acc00/0x710df789068e61a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e61ad expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787852978.531868:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1787852978.531870:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:3.0:1787852978.531873:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1787852978.531903:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f4921e20800/0x710df789068e61b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852978.531910:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.101@tcp lock: ffff8f4921e20800/0x710df789068e61b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852978.531919:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: ffff8f4921e20800/0x710df789068e61b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787852978.531938:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4910d12d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552326144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787852978.531988:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787852978.532162:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f4910a813c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787852978.532219:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552326144 00000100:00100000:2.0:1787852978.532226:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552326144 00000100:00100000:2.0:1787852978.532269:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1787852978.532277:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4911c02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d48a955-7010-4118-9c7d-f396984ae1ff+15:5834:x1874699552326144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787852978.532290:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787852978.532303:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f49415b8400/0x710df789068e61bb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x710df789068e61b4 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787852978.532326:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f49415b8400/0x710df789068e61bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x710df789068e61b4 expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787852978.532349:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f49415b8400/0x710df789068e61bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x710df789068e61b4 expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787852978.532359:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49415b8400, rc 0) 00000100:00100000:2.0:1787852978.532441:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4911c02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d48a955-7010-4118-9c7d-f396984ae1ff+16:5834:x1874699552326144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 165us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1787852978.532448:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1787852978.532723:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4910d12d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552326144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787852978.532739:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: ffff8f4921e20800/0x710df789068e61b4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e61bb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852978.532749:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: ffff8f4921e20800/0x710df789068e61b4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x710df789068e61bb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787852978.532799:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49079f0f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552326272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787852978.532825:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787852978.532853:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f493c04eb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787852978.532894:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552326272 00000100:00100000:3.0:1787852978.532898:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552326272 00000100:00100000:3.0:1787852978.532929:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1787852978.532936:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4911c01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+16:5834:x1874699552326272:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787852978.533277:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4911c01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+16:5834:x1874699552326272:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 341us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1787852978.533284:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787852978.533412:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49079f0f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552326272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787852978.533442:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49079f0f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552326400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787852978.533496:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787852978.533516:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f493c04eb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787852978.534213:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552326400 00000100:00100000:3.0:1787852978.534222:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552326400 00000100:00100000:3.0:1787852978.534274:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787852978.534283:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4911c03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+16:5834:x1874699552326400:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787852978.534466:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4911c03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+16:5834:x1874699552326400:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 184us (968us total) trans 0 rc 0/0 00000100:00100000:3.0:1787852978.534483:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787852978.534593:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49079f0f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552326400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787852978.535045:0:8468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49415a6d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d48a955-7010-4118-9c7d-f396984ae1ff:8468:1874699552326528:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787852978.535089:0:8468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787852978.535131:0:8468:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f4904c00540 going to sleep for 11 seconds 00000100:00100000:3.0:1787852978.535292:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552326528 00000100:00100000:3.0:1787852978.535297:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552326528 00000100:00100000:3.0:1787852978.535330:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787852978.535338:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4911c00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+16:8468:x1874699552326528:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787852978.535502:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4911c00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+16:8468:x1874699552326528:12345-0@lo:502:llog_process_th.0 Request processed in 164us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1787852978.535510:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1787852978.535715:0:8468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49415a6d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d48a955-7010-4118-9c7d-f396984ae1ff:8468:1874699552326528:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787852978.535739:0:8468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787852978.535748:0:8468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787852978.535750:0:8468:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787852978.535755:0:8468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1787852978.535775:0:8468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49415a6d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d48a955-7010-4118-9c7d-f396984ae1ff:8468:1874699552326656:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787852978.535809:0:8468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787852978.535838:0:8468:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f4904c00540 going to sleep for 11 seconds 00000100:00100000:3.0:1787852978.535884:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552326656 00000100:00100000:3.0:1787852978.535888:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552326656 00000100:00100000:3.0:1787852978.535916:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787852978.535922:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4911c00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d48a955-7010-4118-9c7d-f396984ae1ff+16:8468:x1874699552326656:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787852978.536188:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4911c00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d48a955-7010-4118-9c7d-f396984ae1ff+16:8468:x1874699552326656:12345-0@lo:502:llog_process_th.0 Request processed in 265us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1787852978.536215:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1787852978.536281:0:8468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49415a6d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d48a955-7010-4118-9c7d-f396984ae1ff:8468:1874699552326656:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787852978.536298:0:8468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787852978.536302:0:8468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787852978.536304:0:8468:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787852978.536308:0:8468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:1.0:1787852978.536454:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:1.0:1787852978.536482:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.101@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1787852978.536495:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f4921e20800/0x710df789068e61b4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e61bb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852978.536506:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: ffff8f4921e20800/0x710df789068e61b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e61bb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787852978.536515:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787852978.536517:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8f492abd6000 from 39 10000000:01000000:1.0:1787852978.536520:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787852978.536545:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f492a8aca00/0x710df789068e61c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852978.536552:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.101@tcp lock: ffff8f492a8aca00/0x710df789068e61c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852978.536562:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: ffff8f492a8aca00/0x710df789068e61c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787852978.536600:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49079f0f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552326784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787852978.536627:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787852978.536658:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f493c04eb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787852978.536763:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552326784 00000100:00100000:3.0:1787852978.536767:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552326784 00000100:00100000:3.0:1787852978.536817:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787852978.536824:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4911c03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+16:5834:x1874699552326784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787852978.536834:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787852978.536852:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f4921e20600/0x710df789068e61c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x710df789068e61c2 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852978.536878:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f4921e20600/0x710df789068e61c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x710df789068e61c2 expref: 17 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852978.536889:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f4921e20600/0x710df789068e61c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x710df789068e61c2 expref: 17 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852978.536898:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4921e20600, rc 0) 00000100:00100000:3.0:1787852978.536929:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4911c03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+17:5834:x1874699552326784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1787852978.536934:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787852978.537170:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49079f0f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552326784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787852978.537183:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: ffff8f492a8aca00/0x710df789068e61c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e61c9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787852978.537202:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: ffff8f492a8aca00/0x710df789068e61c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x710df789068e61c9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787852978.537244:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49415a6d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552326912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787852978.537270:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787852978.537298:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f4904c00540 going to sleep for 11 seconds 00000100:00100000:3.0:1787852978.537339:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552326912 00000100:00100000:3.0:1787852978.537343:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552326912 00000100:00100000:3.0:1787852978.537373:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1787852978.537380:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4911c00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d48a955-7010-4118-9c7d-f396984ae1ff+17:5834:x1874699552326912:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787852978.537858:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4911c00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d48a955-7010-4118-9c7d-f396984ae1ff+17:5834:x1874699552326912:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 477us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1787852978.537875:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1787852978.537995:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49415a6d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552326912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787852978.538159:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49415a6d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552327040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787852978.538196:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787852978.538217:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f4904c00540 going to sleep for 11 seconds 00000100:00100000:2.0:1787852978.538232:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552327040 00000100:00100000:2.0:1787852978.538236:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552327040 00000100:00100000:2.0:1787852978.538264:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787852978.538270:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4911c01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+17:5834:x1874699552327040:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787852978.538399:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4911c01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+17:5834:x1874699552327040:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 129us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1787852978.538406:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787852978.538436:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49415a6d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552327040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787852978.545281:0:8469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49415a6d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d48a955-7010-4118-9c7d-f396984ae1ff:8469:1874699552327168:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787852978.545369:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787852978.545419:0:8469:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f4904c003c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787852978.545482:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552327168 00000100:00100000:3.0:1787852978.545489:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552327168 00000100:00100000:3.0:1787852978.545538:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1787852978.545548:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4911c02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+17:8469:x1874699552327168:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787852978.545841:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4911c02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+17:8469:x1874699552327168:12345-0@lo:502:llog_process_th.0 Request processed in 295us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1787852978.545850:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787852978.546440:0:8469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49415a6d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d48a955-7010-4118-9c7d-f396984ae1ff:8469:1874699552327168:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787852978.546511:0:8469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49415a6d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d48a955-7010-4118-9c7d-f396984ae1ff:8469:1874699552327296:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787852978.546561:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787852978.546616:0:8469:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f4904c003c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787852978.546910:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552327296 00000100:00100000:3.0:1787852978.546917:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552327296 00000100:00100000:3.0:1787852978.546958:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1787852978.546967:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4911c03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d48a955-7010-4118-9c7d-f396984ae1ff+17:8469:x1874699552327296:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787852978.547421:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4911c03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d48a955-7010-4118-9c7d-f396984ae1ff+17:8469:x1874699552327296:12345-0@lo:502:llog_process_th.0 Request processed in 454us (859us total) trans 0 rc 0/0 00000100:00100000:3.0:1787852978.547428:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1787852978.551922:0:8469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49415a6d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d48a955-7010-4118-9c7d-f396984ae1ff:8469:1874699552327296:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1787852978.551993:0:8469:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1787852978.555619:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1787852978.555656:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787852978.555669:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f492a8aca00/0x710df789068e61c2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e61c9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852978.555682:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: ffff8f492a8aca00/0x710df789068e61c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e61c9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787852978.555693:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1787852978.555695:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:3.0:1787852978.555698:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787852978.555751:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f4921e21400/0x710df789068e61d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852978.555772:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.101@tcp lock: ffff8f4921e21400/0x710df789068e61d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852978.555784:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: ffff8f4921e21400/0x710df789068e61d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787852978.555812:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4910d12580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552327424:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787852978.555887:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787852978.555931:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f490613c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787852978.556031:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552327424 00000100:00100000:1.0:1787852978.556038:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552327424 00000100:00100000:1.0:1787852978.556092:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1787852978.556111:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4911c00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+17:5834:x1874699552327424:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787852978.556133:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787852978.556146:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f492a8adc00/0x710df789068e61d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x710df789068e61d0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852978.556171:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f492a8adc00/0x710df789068e61d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x710df789068e61d0 expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852978.556182:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f492a8adc00/0x710df789068e61d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x710df789068e61d0 expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852978.556189:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f492a8adc00, rc 0) 00000100:00100000:1.0:1787852978.556226:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4911c00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+18:5834:x1874699552327424:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1787852978.556233:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1787852978.556509:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4910d12580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552327424:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787852978.556527:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: ffff8f4921e21400/0x710df789068e61d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e61d7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852978.556536:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: ffff8f4921e21400/0x710df789068e61d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x710df789068e61d7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787852978.557213:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4910d12580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552327552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787852978.557255:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787852978.557292:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f490613c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787852978.558143:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552327552 00000100:00100000:2.0:1787852978.558151:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552327552 00000100:00100000:2.0:1787852978.558198:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1787852978.558206:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4911c03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d48a955-7010-4118-9c7d-f396984ae1ff+18:5834:x1874699552327552:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787852978.558488:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4911c03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d48a955-7010-4118-9c7d-f396984ae1ff+18:5834:x1874699552327552:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 281us (1232us total) trans 0 rc 0/0 00000100:00100000:2.0:1787852978.558495:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1787852978.558880:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4910d12580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552327552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787852978.558925:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4910d12580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552327680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787852978.558969:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787852978.559002:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f490613c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787852978.559174:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552327680 00000100:00100000:2.0:1787852978.559179:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552327680 00000100:00100000:2.0:1787852978.559217:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1787852978.559225:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4911c02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+18:5834:x1874699552327680:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787852978.560157:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4911c02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+18:5834:x1874699552327680:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 930us (1186us total) trans 0 rc 0/0 00000100:00100000:2.0:1787852978.560168:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1787852978.563761:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4910d12580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552327680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787852978.566732:0:8470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49415a70c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d48a955-7010-4118-9c7d-f396984ae1ff:8470:1874699552327808:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787852978.566832:0:8470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787852978.566917:0:8470:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f4904c00900 going to sleep for 11 seconds 00000100:00100000:1.0:1787852978.570712:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552327808 00000100:00100000:1.0:1787852978.570728:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552327808 00000100:00100000:2.0:1787852978.570997:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1787852978.571016:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4911c01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+18:8470:x1874699552327808:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787852978.571681:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4911c01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+18:8470:x1874699552327808:12345-0@lo:502:llog_process_th.0 Request processed in 674us (4848us total) trans 0 rc 0/0 00000100:00100000:2.0:1787852978.571690:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1787852978.571813:0:8470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49415a70c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d48a955-7010-4118-9c7d-f396984ae1ff:8470:1874699552327808:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787852978.571851:0:8470:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787852978.571867:0:8470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787852978.571870:0:8470:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787852978.571876:0:8470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1787852978.571914:0:8470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4910d11e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d48a955-7010-4118-9c7d-f396984ae1ff:8470:1874699552327936:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787852978.571959:0:8470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787852978.571995:0:8470:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f490613c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787852978.572175:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552327936 00000100:00100000:2.0:1787852978.572188:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552327936 00000100:00100000:2.0:1787852978.572228:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1787852978.572235:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4907f78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+18:8470:x1874699552327936:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787852978.572491:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4907f78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+18:8470:x1874699552327936:12345-0@lo:502:llog_process_th.0 Request processed in 255us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1787852978.572498:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1787852978.576827:0:8470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4910d11e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d48a955-7010-4118-9c7d-f396984ae1ff:8470:1874699552327936:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787852978.576888:0:8470:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787852978.576900:0:8470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787852978.576903:0:8470:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787852978.576908:0:8470:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1787852978.581246:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:1.0:1787852978.581287:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.101@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787852978.581299:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f4921e21400/0x710df789068e61d0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e61d7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852978.581312:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: ffff8f4921e21400/0x710df789068e61d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e61d7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787852978.581324:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1787852978.581327:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8f490300cd70 from 1 10000000:01000000:1.0:1787852978.581330:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787852978.581375:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f492a8ad400/0x710df789068e61de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852978.581401:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.101@tcp lock: ffff8f492a8ad400/0x710df789068e61de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852978.581415:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: ffff8f492a8ad400/0x710df789068e61de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787852978.581442:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49079f0f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552328064:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787852978.583309:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787852978.583348:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f493c04e0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787852978.583603:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552328064 00000100:00100000:2.0:1787852978.583612:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552328064 00000100:00100000:2.0:1787852978.583669:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1787852978.583679:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4906231450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+18:5834:x1874699552328064:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787852978.583696:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787852978.583724:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f49415b8e00/0x710df789068e61e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x710df789068e61de expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787852978.583754:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f49415b8e00/0x710df789068e61e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x710df789068e61de expref: 19 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787852978.583766:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f49415b8e00/0x710df789068e61e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x710df789068e61de expref: 19 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787852978.583775:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49415b8e00, rc 0) 00000100:00100000:2.0:1787852978.583836:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4906231450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+19:5834:x1874699552328064:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 159us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1787852978.583844:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1787852978.584689:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49079f0f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552328064:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787852978.584720:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: ffff8f492a8ad400/0x710df789068e61de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e61e5 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852978.584731:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: ffff8f492a8ad400/0x710df789068e61de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x710df789068e61e5 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787852978.584810:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49079f0f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552328192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787852978.584850:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787852978.584890:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f493c04e0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787852978.586045:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552328192 00000100:00100000:2.0:1787852978.586056:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552328192 00000100:00100000:2.0:1787852978.586125:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1787852978.586136:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4906231050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+19:5834:x1874699552328192:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787852978.586439:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4906231050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+19:5834:x1874699552328192:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 303us (1587us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787852978.586446:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1787852978.586882:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49079f0f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552328192:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1787852978.586926:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.101@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787852978.586936:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f492a8ad400/0x710df789068e61de lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e61e5 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852978.586946:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: ffff8f492a8ad400/0x710df789068e61de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e61e5 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852978.985843:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787852979.587546:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787852979.588020:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526083328 00000100:00100000:2.0:1787852979.588032:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526083328 00000100:00100000:2.0:1787852979.588107:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 167 00000100:00100000:2.0:1787852979.588117:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4906230850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af755b38-4932-400a-92cc-ddad0ca077a5+8:5609:x1874699526083328:12345-192.168.204.1@tcp:101: 00010000:00010000:2.0:1787852979.588135:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787852979.588156:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f49415b9a00/0x710df789068e61ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xd0a9c5079389577 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787852979.588187:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f49415b9a00/0x710df789068e61ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389577 expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787852979.588200:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f49415b9a00/0x710df789068e61ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389577 expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787852979.588211:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49415b9a00, rc 0) 00000100:00100000:2.0:1787852979.588292:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4906230850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af755b38-4932-400a-92cc-ddad0ca077a5+9:5609:x1874699526083328:12345-192.168.204.1@tcp:101: Request processed in 170us (750us total) trans 0 rc 0/0 00000100:00100000:2.0:1787852979.588299:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 167 00000100:00100000:0.0:1787852979.602522:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787852979.602857:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526083456 00000100:00100000:3.0:1787852979.602871:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526083456 00000100:00100000:3.0:1787852979.602948:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 168 00000100:00100000:3.0:1787852979.602958:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4906232c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af755b38-4932-400a-92cc-ddad0ca077a5+9:5609:x1874699526083456:12345-192.168.204.1@tcp:501: 00000100:00100000:3.0:1787852979.603532:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4906232c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af755b38-4932-400a-92cc-ddad0ca077a5+9:5609:x1874699526083456:12345-192.168.204.1@tcp:501: Request processed in 572us (1018us total) trans 0 rc 0/0 00000100:00100000:3.0:1787852979.603541:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 168 00000100:00100000:0.0:1787852979.613669:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787852979.614038:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526083584 00000100:00100000:3.0:1787852979.614049:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526083584 00000100:00100000:3.0:1787852979.614238:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 169 00000100:00100000:3.0:1787852979.614250:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4906233c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af755b38-4932-400a-92cc-ddad0ca077a5+9:5609:x1874699526083584:12345-192.168.204.1@tcp:503: 00000100:00100000:3.0:1787852979.614785:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4906233c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af755b38-4932-400a-92cc-ddad0ca077a5+9:5609:x1874699526083584:12345-192.168.204.1@tcp:503: Request processed in 536us (1127us total) trans 0 rc 0/0 00000100:00100000:3.0:1787852979.614797:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 169 00000100:00100000:0.0:1787852979.629642:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787852979.629810:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526083712 00000100:00100000:3.0:1787852979.629820:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526083712 00000100:00100000:3.0:1787852979.629880:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 170 00000100:00100000:3.0:1787852979.629890:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4906231c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af755b38-4932-400a-92cc-ddad0ca077a5+9:6089:x1874699526083712:12345-192.168.204.1@tcp:502: 00000100:00100000:3.0:1787852979.630225:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4906231c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af755b38-4932-400a-92cc-ddad0ca077a5+9:6089:x1874699526083712:12345-192.168.204.1@tcp:502: Request processed in 336us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1787852979.630241:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 170 00000100:00100000:0.0:1787852979.643937:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787852979.645019:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526083840 00000100:00100000:3.0:1787852979.645033:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526083840 00000100:00100000:2.0:1787852979.645303:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 171 00000100:00100000:2.0:1787852979.645316:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4911c02850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af755b38-4932-400a-92cc-ddad0ca077a5+9:6089:x1874699526083840:12345-192.168.204.1@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787852979.645819:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4911c02850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af755b38-4932-400a-92cc-ddad0ca077a5+9:6089:x1874699526083840:12345-192.168.204.1@tcp:502:llog_process_th.0 Request processed in 504us (1889us total) trans 0 rc 0/0 00000100:00100000:2.0:1787852979.645827:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 171 00000100:00100000:0.0:1787852979.663371:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787852979.663552:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526083968 00000100:00100000:3.0:1787852979.663982:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526083968 00000100:00100000:0.0:1787852979.674641:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 172 00000100:00100000:0.0:1787852979.674659:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4906232050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af755b38-4932-400a-92cc-ddad0ca077a5+9:5609:x1874699526083968:12345-192.168.204.1@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787852979.674690:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787852979.674714:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f4900031600/0x710df789068e61f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xd0a9c507938957e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852979.674748:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f4900031600/0x710df789068e61f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c507938957e expref: 10 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852979.674760:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f4900031600/0x710df789068e61f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c507938957e expref: 10 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852979.674770:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4900031600, rc 0) 00000100:00100000:0.0:1787852979.674857:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4906232050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af755b38-4932-400a-92cc-ddad0ca077a5+10:5609:x1874699526083968:12345-192.168.204.1@tcp:101:ll_cfg_requeue.0 Request processed in 203us (11498us total) trans 0 rc 0/0 00000100:00100000:0.0:1787852979.674865:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 172 00000100:00100000:0.0:1787852979.678336:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787852979.678484:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526084096 00000100:00100000:2.0:1787852979.678495:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526084096 00000100:00100000:2.0:1787852979.678557:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 173 00000100:00100000:2.0:1787852979.678616:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4906232850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af755b38-4932-400a-92cc-ddad0ca077a5+10:5609:x1874699526084096:12345-192.168.204.1@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787852979.678932:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4906232850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af755b38-4932-400a-92cc-ddad0ca077a5+10:5609:x1874699526084096:12345-192.168.204.1@tcp:501:ll_cfg_requeue.0 Request processed in 365us (606us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787852979.678941:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 173 00010000:00010000:0.0:1787852980.009988:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787852980.544453:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787852980.544541:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787852980.544602:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787852980.546443:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787852980.546746:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526084480 00000100:00100000:0.0:1787852980.546755:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526084480 00000100:00100000:0.0:1787852980.546812:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526084608 00000100:00100000:0.0:1787852980.546815:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526084608 00000100:00100000:0.0:1787852980.546840:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 20 00000100:00100000:0.0:1787852980.546851:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49079f0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+5:2365:x1874699526084480:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:0.0:1787852980.546937:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49079f0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+5:2365:x1874699526084480:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 88us (2395us total) trans 0 rc 0/0 00000100:00100000:0.0:1787852980.546945:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 20 00000100:00100000:0.0:1787852980.546962:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 21 00000100:00100000:0.0:1787852980.546968:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49216e7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+5:2365:x1874699526084608:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:0.0:1787852980.546988:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49216e7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+5:2365:x1874699526084608:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 22us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1787852980.546994:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 21 00000100:00100000:0.0:1787852980.547010:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526084352 00000100:00100000:0.0:1787852980.547013:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526084352 00000100:00100000:0.0:1787852980.547039:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 36 00000100:00100000:0.0:1787852980.547045:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49216e4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+6:2365:x1874699526084352:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:0.0:1787852980.547072:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49216e4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+6:2365:x1874699526084352:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 27us (2470us total) trans 0 rc 0/0 00000100:00100000:0.0:1787852980.547078:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 36 00000100:00080000:1.0:1787852980.547603:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787852980.547608:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787852980.547610:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787852980.547976:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526084224 00000100:00100000:2.0:1787852980.547987:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526084224 00000100:00100000:1.0:1787852980.548157:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 174 00000100:00100000:1.0:1787852980.548294:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4906233450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af755b38-4932-400a-92cc-ddad0ca077a5+10:2365:x1874699526084224:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:1.0:1787852980.548438:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4906233450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af755b38-4932-400a-92cc-ddad0ca077a5+10:2365:x1874699526084224:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 273us (3995us total) trans 0 rc 0/0 00000100:00100000:1.0:1787852980.548446:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 174 00010000:00010000:1.0:1787852981.033996:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787852981.518164:0:8508:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff70cd13d0 20000000:00000080:3.0:1787852981.518185:0:8508:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8f493c74d400 uarg=0000000000000000 20000000:01000000:3.0:1787852981.518229:0:8508:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787852981.518236:0:8508:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787852981.518242:0:8508:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1787852981.523053:0:8509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:1.0:1787852981.530419:0:8508:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:1.0:1787852981.542147:0:8508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:1.0:1787852981.542209:0:8508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:1.0:1787852981.542282:0:8508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:1.0:1787852981.542302:0:8508:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787852981.542323:0:8508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f492a8ade00/0x710df789068e61fa lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852981.542345:0:8508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f49421e3e00/0x710df789068e5fca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x710df789068e5fc3 expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852981.542353:0:8508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f49013fc600/0x710df789068e6010 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x710df789068e6009 expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852981.542359:0:8508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f4900031a00/0x710df789068e609c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x710df789068e6095 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852981.542377:0:8508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f49421e3000/0x710df789068e6159 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389546 expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852981.542384:0:8508:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f492a8ade00/0x710df789068e61fa lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852981.542444:0:8508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f49421e3000/0x710df789068e6159 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389546 expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852981.542462:0:8508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f49421e3000/0x710df789068e6159 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389546 expref: 9 pid: 5831 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787852981.542477:0:8508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49056d9e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8508:1874699552328320:192.168.204.1@tcp:104: 00010000:00010000:1.0:1787852981.542629:0:8508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f4900031a00/0x710df789068e609c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x710df789068e6095 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852981.542637:0:8508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f4900031a00/0x710df789068e609c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x710df789068e6095 expref: 18 pid: 5831 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787852981.542658:0:8508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49056da580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8508:1874699552328448:0@lo:104: 00000100:00100000:1.0:1787852981.542708:0:8508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787852981.542749:0:8508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f49013fc600/0x710df789068e6010 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x710df789068e6009 expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852981.542758:0:8508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f49013fc600/0x710df789068e6010 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x710df789068e6009 expref: 18 pid: 5829 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787852981.542766:0:8508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49056dad00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8508:1874699552328576:0@lo:104: 00010000:00010000:1.0:1787852981.542801:0:8508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f49421e3e00/0x710df789068e5fca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x710df789068e5fc3 expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852981.542809:0:8508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f49421e3e00/0x710df789068e5fca lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x710df789068e5fc3 expref: 18 pid: 5829 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787852981.542817:0:8508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49056db480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8508:1874699552328704:0@lo:104: 00000100:00100000:1.0:1787852981.542836:0:8508:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f493c04ee40 going to sleep for 11 seconds 00000100:00100000:3.0:1787852981.542927:0:5821:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787852981.542947:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787852981.542971:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787852981.542986:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552328448 00000100:00100000:3.0:1787852981.542993:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552328448 00000100:00100000:3.0:1787852981.543028:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552328576 00000100:00100000:3.0:1787852981.543030:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552328576 00000100:00100000:3.0:1787852981.543038:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552328704 00000100:00100000:3.0:1787852981.543040:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552328704 00000100:00100000:3.0:1787852981.543051:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787852981.543059:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493c7e5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5d48a955-7010-4118-9c7d-f396984ae1ff+5:8508:x1874699552328448:12345-0@lo:104: 00010000:00010000:3.0:1787852981.543072:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.101@tcp lock: ffff8f49029cd200/0x710df789068e6095 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x710df789068e609c expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852981.543118:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787852981.543124:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493c7e5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5d48a955-7010-4118-9c7d-f396984ae1ff+5:8508:x1874699552328448:12345-0@lo:104: Request processed in 66us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1787852981.543130:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787852981.543165:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787852981.543178:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4910d12940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5d48a955-7010-4118-9c7d-f396984ae1ff+4:8508:x1874699552328576:12345-0@lo:104: 00010000:00010000:3.0:1787852981.543186:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.101@tcp lock: ffff8f49029cc200/0x710df789068e6009 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x710df789068e6010 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852981.543214:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787852981.543218:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4910d12940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5d48a955-7010-4118-9c7d-f396984ae1ff+4:8508:x1874699552328576:12345-0@lo:104: Request processed in 42us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1787852981.543224:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787852981.543235:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787852981.543240:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4910d11680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5d48a955-7010-4118-9c7d-f396984ae1ff+3:8508:x1874699552328704:12345-0@lo:104: 00010000:00010000:3.0:1787852981.543246:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.101@tcp lock: ffff8f49421e3200/0x710df789068e5fc3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x710df789068e5fca expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852981.543275:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1787852981.543280:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4910d11680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5d48a955-7010-4118-9c7d-f396984ae1ff+3:8508:x1874699552328704:12345-0@lo:104: Request processed in 40us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1787852981.543285:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:3.0:1787852981.543303:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787852981.543308:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.101@tcp lock: ffff8f49029cd200/0x710df789068e6095 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x710df789068e609c expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852981.543316:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49029cd200 already unused, calling callback (ffffffffc1b55c20) 10000000:00010000:3.0:1787852981.543320:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.101@tcp lock: ffff8f49029cd200/0x710df789068e6095 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x710df789068e609c expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852981.543329:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.101@tcp lock: ffff8f49029cd200/0x710df789068e6095 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x710df789068e609c expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787852981.543336:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.101@tcp lock: ffff8f49029cd200/0x710df789068e6095 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x710df789068e609c expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787852981.543351:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787852981.543388:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.101@tcp lock: ffff8f49029cd200/0x710df789068e6095 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x710df789068e609c expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852981.543394:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787852981.543418:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.101@tcp lock: ffff8f49029cd200/0x710df789068e6095 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x710df789068e609c expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852981.543424:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.101@tcp lock: ffff8f49029cd200/0x710df789068e6095 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x710df789068e609c expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852981.543445:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787852981.543448:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.101@tcp lock: ffff8f49029cc200/0x710df789068e6009 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x710df789068e6010 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852981.543453:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49029cc200 already unused, calling callback (ffffffffc1b55c20) 10000000:00010000:3.0:1787852981.543456:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.101@tcp lock: ffff8f49029cc200/0x710df789068e6009 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x710df789068e6010 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852981.543462:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.101@tcp lock: ffff8f49029cc200/0x710df789068e6009 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x710df789068e6010 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787852981.543468:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.101@tcp lock: ffff8f49029cc200/0x710df789068e6009 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x710df789068e6010 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787852981.543473:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787852981.543486:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.101@tcp lock: ffff8f49029cc200/0x710df789068e6009 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x710df789068e6010 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852981.543491:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787852981.543512:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.101@tcp lock: ffff8f49029cc200/0x710df789068e6009 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x710df789068e6010 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852981.543518:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.101@tcp lock: ffff8f49029cc200/0x710df789068e6009 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x710df789068e6010 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852981.543529:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787852981.543532:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.101@tcp lock: ffff8f49421e3200/0x710df789068e5fc3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x710df789068e5fca expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852981.543537:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49421e3200 already unused, calling callback (ffffffffc1b55c20) 10000000:00010000:3.0:1787852981.543540:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.101@tcp lock: ffff8f49421e3200/0x710df789068e5fc3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x710df789068e5fca expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852981.543546:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.101@tcp lock: ffff8f49421e3200/0x710df789068e5fc3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x710df789068e5fca expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787852981.543552:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.101@tcp lock: ffff8f49421e3200/0x710df789068e5fc3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x710df789068e5fca expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787852981.543558:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787852981.543607:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.101@tcp lock: ffff8f49421e3200/0x710df789068e5fc3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x710df789068e5fca expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852981.543613:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787852981.543619:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.101@tcp lock: ffff8f49421e3200/0x710df789068e5fc3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x710df789068e5fca expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852981.543626:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.101@tcp lock: ffff8f49421e3200/0x710df789068e5fc3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x710df789068e5fca expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852981.543637:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787852981.543655:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787852981.543657:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787852981.543663:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787852981.543685:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4910d11e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5d48a955-7010-4118-9c7d-f396984ae1ff:3308:1874699552328960:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787852981.543715:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787852981.543742:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787852981.543747:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4910d12580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5d48a955-7010-4118-9c7d-f396984ae1ff:3308:1874699552329088:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787852981.543765:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787852981.543795:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552328960 00000100:00100000:3.0:1787852981.543799:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552328960 00010000:00010000:3.0:1787852981.543820:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f49013fc600/0x710df789068e6010 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x710df789068e6009 expref: 19 pid: 5829 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787852981.543839:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552329088 00000100:00100000:3.0:1787852981.543842:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552329088 00010000:00010000:3.0:1787852981.543851:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f49421e3e00/0x710df789068e5fca lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x710df789068e5fc3 expref: 20 pid: 5829 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787852981.543865:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787852981.543870:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4910d12d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5d48a955-7010-4118-9c7d-f396984ae1ff+20:3308:x1874699552328960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787852981.543881:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787852981.543887:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f49013fc600/0x710df789068e6010 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x710df789068e6009 expref: 20 pid: 5829 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852981.543898:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f49013fc600/0x710df789068e6010 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x710df789068e6009 expref: 20 pid: 5829 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852981.543917:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787852981.543946:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4910d12d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5d48a955-7010-4118-9c7d-f396984ae1ff+20:3308:x1874699552328960:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1787852981.543962:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787852981.543975:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787852981.543981:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4910d13480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5d48a955-7010-4118-9c7d-f396984ae1ff+19:3308:x1874699552329088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787852981.543989:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787852981.543993:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f49421e3e00/0x710df789068e5fca lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x710df789068e5fc3 expref: 19 pid: 5829 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852981.544001:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f49421e3e00/0x710df789068e5fca lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x710df789068e5fc3 expref: 19 pid: 5829 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852981.544010:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787852981.544030:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4910d13480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5d48a955-7010-4118-9c7d-f396984ae1ff+19:3308:x1874699552329088:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1787852981.544036:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787852981.544066:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4910d12580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5d48a955-7010-4118-9c7d-f396984ae1ff:3308:1874699552329088:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787852981.544074:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4910d11e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5d48a955-7010-4118-9c7d-f396984ae1ff:3308:1874699552328960:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787852981.544267:0:8508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49056da580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8508:1874699552328448:0@lo:104: 00010000:00010000:1.0:1787852981.544276:0:8508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f49013fc600/0x710df789068e6010 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x710df789068e6009 expref: 18 pid: 5829 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787852981.544288:0:8508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49056dad00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8508:1874699552328576:0@lo:104: 00010000:00010000:1.0:1787852981.544295:0:8508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f49421e3e00/0x710df789068e5fca lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x710df789068e5fc3 expref: 17 pid: 5829 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787852981.544303:0:8508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49056db480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8508:1874699552328704:0@lo:104: 00000100:00100000:3.0:1787852981.544721:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4910d130c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5d48a955-7010-4118-9c7d-f396984ae1ff:3307:1874699552328832:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787852981.544756:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787852981.544848:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787852981.544860:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552328832 00000100:00100000:0.0:1787852981.544864:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552328832 00010000:00010000:0.0:1787852981.544884:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f4900031a00/0x710df789068e609c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x710df789068e6095 expref: 17 pid: 5831 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787852981.544905:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787852981.544911:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4910d11e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d48a955-7010-4118-9c7d-f396984ae1ff+17:3307:x1874699552328832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787852981.544921:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787852981.544925:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f4900031a00/0x710df789068e609c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x710df789068e6095 expref: 17 pid: 5831 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852981.544942:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f4900031a00/0x710df789068e609c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x710df789068e6095 expref: 17 pid: 5831 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852981.544955:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f4900031a00/0x710df789068e609c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x710df789068e6095 expref: 17 pid: 5831 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787852981.544966:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787852981.545005:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4910d11e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d48a955-7010-4118-9c7d-f396984ae1ff+16:3307:x1874699552328832:12345-0@lo:103:ldlm_bl.0 Request processed in 94us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1787852981.545012:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787852981.546073:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4910d130c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5d48a955-7010-4118-9c7d-f396984ae1ff:3307:1874699552328832:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787852981.548725:0:8508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49056d9e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8508:1874699552328320:192.168.204.1@tcp:104: 00010000:00010000:1.0:1787852981.548763:0:8508:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f492a8ade00/0x710df789068e61fa lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787852981.555987:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787852981.557622:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526084736 00000100:00100000:1.0:1787852981.557636:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526084736 00010000:00010000:1.0:1787852981.557696:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f49421e3000/0x710df789068e6159 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389546 expref: 10 pid: 5831 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787852981.557736:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 24 00000100:00100000:1.0:1787852981.557746:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f494159e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:af755b38-4932-400a-92cc-ddad0ca077a5+10:2363:x1874699526084736:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787852981.557781:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787852981.557788:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f49421e3000/0x710df789068e6159 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389546 expref: 10 pid: 5831 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852981.557799:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f49421e3000/0x710df789068e6159 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389546 expref: 10 pid: 5831 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852981.557820:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f49421e3000/0x710df789068e6159 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389546 expref: 10 pid: 5831 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852981.557839:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f492a8ade00/0x710df789068e61fa lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852981.557848:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f492a8ade00/0x710df789068e61fa lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852981.557866:0:5824:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f492a8ade00/0x710df789068e61fa lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852981.557873:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f492a8ade00/0x710df789068e61fa lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852981.557880:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f492a8ade00/0x710df789068e61fa lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852981.557887:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f492a8ade00/0x710df789068e61fa lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852981.557893:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f492a8ade00 already unused, calling callback (ffffffffc1528440) 00010000:00010000:1.0:1787852981.557897:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f492a8ade00/0x710df789068e61fa lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852981.557916:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f492a8ade00/0x710df789068e61fa lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852981.557944:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f492a8ade00/0x710df789068e61fa lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852981.557955:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787852981.558015:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f494159e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:af755b38-4932-400a-92cc-ddad0ca077a5+9:2363:x1874699526084736:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 269us (2040us total) trans 0 rc 0/0 00000100:00100000:1.0:1787852981.558023:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 24 00010000:00010000:2.0:1787852981.558043:0:8508:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f492a8ade00/0x710df789068e61fa lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787852981.558051:0:8508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f492a8ade00/0x710df789068e61fa lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787852981.558058:0:8508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f492a8ade00/0x710df789068e61fa lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852982.060016:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787852983.018103:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4910d130c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5d48a955-7010-4118-9c7d-f396984ae1ff:3306:1874699552329216:0@lo:400:kworker.0 00000100:00100000:2.0:1787852983.018182:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787852983.018239:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4910d103c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1874699552329728:0@lo:400:kworker.0 00000100:00100000:2.0:1787852983.018270:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787852983.018299:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787852983.018305:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4910d11a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874699552329344:0@lo:400:kworker.0 00000100:00100000:2.0:1787852983.018492:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787852983.018521:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4910d13840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552329856:0@lo:400:kworker.0 00000100:00100000:2.0:1787852983.018552:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787852983.018634:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552329728 00000100:00100000:2.0:1787852983.018642:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552329728 00000100:00100000:2.0:1787852983.018700:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552329344 00000100:00100000:2.0:1787852983.018704:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552329344 00000100:00100000:2.0:1787852983.018726:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787852983.018735:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49415a43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874699552329728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787852983.018883:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787852983.018895:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49415a5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874699552329344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787852983.018937:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49415a5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874699552329344:12345-0@lo:400:kworker.0 Request processed in 46us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1787852983.018944:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787852983.019004:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49415a43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874699552329728:12345-0@lo:400:kworker.0 Request processed in 270us (733us total) trans 0 rc 0/0 00000100:00100000:2.0:1787852983.019011:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:2.0:1787852983.019029:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787852983.019062:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4910d11a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874699552329344:0@lo:400:kworker.0 00000100:00100000:2.0:1787852983.019075:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4910d103c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1874699552329728:0@lo:400:kworker.0 00000100:00100000:0.0:1787852983.022848:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552329216 00000100:00100000:0.0:1787852983.022866:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552329216 00000100:00100000:0.0:1787852983.022943:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1787852983.022954:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4906232450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d48a955-7010-4118-9c7d-f396984ae1ff+16:3306:x1874699552329216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787852983.023085:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4906232450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d48a955-7010-4118-9c7d-f396984ae1ff+16:3306:x1874699552329216:12345-0@lo:400:kworker.0 Request processed in 132us (4902us total) trans 0 rc 0/0 00000100:00100000:0.0:1787852983.023092:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1787852983.023137:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552329856 00000100:00100000:0.0:1787852983.023142:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552329856 00000100:00100000:0.0:1787852983.023231:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787852983.023239:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49415a70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874699552329856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787852983.023275:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49415a70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874699552329856:12345-0@lo:400:kworker.0 Request processed in 38us (4724us total) trans 0 rc 0/0 00000100:00100000:0.0:1787852983.023281:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:0.0:1787852983.023431:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f4910d13840 x1874699552329856/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787852999 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787852983.023468:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4910d13840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552329856:0@lo:400:kworker.0 00000100:00100000:0.0:1787852983.023483:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4910d130c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5d48a955-7010-4118-9c7d-f396984ae1ff:3306:1874699552329216:0@lo:400:kworker.0 00000100:00080000:0.0:1787852983.023517:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787852983.023693:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4910d13c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874699552329472:0@lo:400:kworker.0 00000100:00100000:3.0:1787852983.023735:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787852983.023771:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787852983.025542:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552329472 00000100:00100000:0.0:1787852983.025559:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552329472 00000100:00100000:0.0:1787852983.025660:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787852983.025670:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4910d10f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1874699552329472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787852983.025761:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4910d10f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1874699552329472:12345-0@lo:400:kworker.0 Request processed in 92us (2024us total) trans 0 rc 0/0 00000100:00100000:0.0:1787852983.025969:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:0.0:1787852983.025999:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787852983.026093:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4910d112c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1874699552329600:0@lo:400:kworker.0 00000100:00100000:3.0:1787852983.026141:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1787852983.026215:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f4910d13c00 x1874699552329472/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787852999 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787852983.026228:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4910d13c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874699552329472:0@lo:400:kworker.0 00000100:00100000:0.0:1787852983.026294:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552329600 00000100:00100000:0.0:1787852983.026298:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552329600 00000100:00100000:0.0:1787852983.026346:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787852983.026353:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4910d130c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874699552329600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787852983.026395:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4910d130c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874699552329600:12345-0@lo:400:kworker.0 Request processed in 42us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1787852983.026401:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:3.0:1787852983.026449:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787852983.026470:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4910d112c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1874699552329600:0@lo:400:kworker.0 00010000:00010000:3.0:1787852983.085843:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787852983.239101:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787852983.239191:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526084864 00000100:00100000:1.0:1787852983.239202:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526084864 00000100:00100000:1.0:1787852983.239269:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 176 00000100:00100000:1.0:1787852983.239280:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4906230050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af755b38-4932-400a-92cc-ddad0ca077a5+9:5609:x1874699526084864:12345-192.168.204.1@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787852983.239300:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787852983.239322:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f492a8ad000/0x710df789068e6201 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd0a9c5079389585 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852983.239362:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f492a8ad000/0x710df789068e6201 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389585 expref: 10 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852983.239374:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f492a8ad000/0x710df789068e6201 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389585 expref: 10 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852983.239403:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f492a8ad000, rc 0) 00000100:00100000:1.0:1787852983.239465:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4906230050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af755b38-4932-400a-92cc-ddad0ca077a5+10:5609:x1874699526084864:12345-192.168.204.1@tcp:101:ll_cfg_requeue.0 Request processed in 187us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1787852983.239472:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 176 00000100:00100000:2.0:1787852983.249916:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787852983.253947:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526084992 00000100:00100000:0.0:1787852983.253968:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526084992 00000100:00100000:0.0:1787852983.254048:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 177 00000100:00100000:0.0:1787852983.254060:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4906230c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af755b38-4932-400a-92cc-ddad0ca077a5+10:5609:x1874699526084992:12345-192.168.204.1@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787852983.254525:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4906230c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af755b38-4932-400a-92cc-ddad0ca077a5+10:5609:x1874699526084992:12345-192.168.204.1@tcp:501:ll_cfg_requeue.0 Request processed in 464us (4618us total) trans 0 rc 0/0 00000100:00100000:0.0:1787852983.254534:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 177 00000100:00100000:1.0:1787852983.266455:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787852983.266508:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526085120 00000100:00100000:1.0:1787852983.266519:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526085120 00000100:00100000:1.0:1787852983.266590:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 178 00000100:00100000:1.0:1787852983.268453:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4906233050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af755b38-4932-400a-92cc-ddad0ca077a5+10:5609:x1874699526085120:12345-192.168.204.1@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787852983.271529:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4906233050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af755b38-4932-400a-92cc-ddad0ca077a5+10:5609:x1874699526085120:12345-192.168.204.1@tcp:503:ll_cfg_requeue.0 Request processed in 4914us (5070us total) trans 0 rc 0/0 00000100:00100000:0.0:1787852983.271547:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 178 00000100:00100000:3.0:1787852983.274373:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787852983.274431:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526085248 00000100:00100000:0.0:1787852983.274451:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526085248 00000100:00100000:0.0:1787852983.274521:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 179 00000100:00100000:0.0:1787852983.274540:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4906231850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af755b38-4932-400a-92cc-ddad0ca077a5+10:6153:x1874699526085248:12345-192.168.204.1@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787852983.274926:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4906231850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af755b38-4932-400a-92cc-ddad0ca077a5+10:6153:x1874699526085248:12345-192.168.204.1@tcp:502:llog_process_th.0 Request processed in 395us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1787852983.274935:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 179 00000100:00100000:3.0:1787852983.282161:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787852983.282246:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526085376 00000100:00100000:0.0:1787852983.282257:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526085376 00000100:00100000:0.0:1787852983.282328:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 180 00000100:00100000:0.0:1787852983.282339:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4906230450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af755b38-4932-400a-92cc-ddad0ca077a5+10:6153:x1874699526085376:12345-192.168.204.1@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787852983.282642:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4906230450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af755b38-4932-400a-92cc-ddad0ca077a5+10:6153:x1874699526085376:12345-192.168.204.1@tcp:502:llog_process_th.0 Request processed in 303us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1787852983.282651:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 180 10000000:01000000:2.0:1787852983.406189:0:5834:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787852983.406199:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f493dc01800 from 4 10000000:01000000:2.0:1787852983.406205:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787852983.406256:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f49415b8000/0x710df789068e6208 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787852983.406269:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.101@tcp lock: ffff8f49415b8000/0x710df789068e6208 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787852983.406282:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: ffff8f49415b8000/0x710df789068e6208 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787852983.406309:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49415a6d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552329984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787852983.406398:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787852983.406467:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f4902af1180 going to sleep for 11 seconds 00000100:00100000:3.0:1787852983.406720:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552329984 00000100:00100000:3.0:1787852983.406729:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552329984 00000100:00100000:3.0:1787852983.406791:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1787852983.406801:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4906233850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+16:5834:x1874699552329984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787852983.406818:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787852983.406846:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f4921e20a00/0x710df789068e620f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x710df789068e6208 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852983.406879:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f4921e20a00/0x710df789068e620f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x710df789068e6208 expref: 17 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852983.406892:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f4921e20a00/0x710df789068e620f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x710df789068e6208 expref: 17 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852983.406901:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4921e20a00, rc 0) 00000100:00100000:3.0:1787852983.406950:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4906233850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+17:5834:x1874699552329984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 151us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1787852983.406958:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1787852983.407160:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49415a6d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552329984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787852983.407187:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: ffff8f49415b8000/0x710df789068e6208 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e620f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787852983.407196:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: ffff8f49415b8000/0x710df789068e6208 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x710df789068e620f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787852983.407256:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49415a6d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552330112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787852983.407283:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787852983.407317:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f4902af1180 going to sleep for 11 seconds 00000100:00100000:0.0:1787852983.407362:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552330112 00000100:00100000:0.0:1787852983.407366:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552330112 00000100:00100000:0.0:1787852983.407391:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1787852983.407398:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f490621c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+17:5834:x1874699552330112:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787852983.407724:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f490621c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+17:5834:x1874699552330112:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 326us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1787852983.407731:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1787852983.407985:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49415a6d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552330112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787852983.408016:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49415a6d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552330240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787852983.408052:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787852983.408074:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f4902af1180 going to sleep for 11 seconds 00000100:00100000:3.0:1787852983.408129:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552330240 00000100:00100000:3.0:1787852983.408140:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552330240 00000100:00100000:3.0:1787852983.408177:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1787852983.408184:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f490621c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+17:5834:x1874699552330240:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787852983.408330:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f490621c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+17:5834:x1874699552330240:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 146us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1787852983.408336:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1787852983.408386:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49415a6d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552330240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787852983.408565:0:8585:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4910d112c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d48a955-7010-4118-9c7d-f396984ae1ff:8585:1874699552330368:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787852983.408806:0:8585:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787852983.408880:0:8585:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f492a8a2d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787852983.414732:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552330368 00000100:00100000:2.0:1787852983.414746:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552330368 00000100:00100000:2.0:1787852983.415743:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1787852983.415756:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f490621e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+17:8585:x1874699552330368:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787852983.416968:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f490621e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+17:8585:x1874699552330368:12345-0@lo:502:llog_process_th.0 Request processed in 1209us (8155us total) trans 0 rc 0/0 00000100:00100000:2.0:1787852983.416980:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1787852983.422376:0:8585:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4910d112c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d48a955-7010-4118-9c7d-f396984ae1ff:8585:1874699552330368:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787852983.422634:0:8585:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787852983.422647:0:8585:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787852983.422650:0:8585:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787852983.422658:0:8585:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f493dc01800 00000020:00000080:0.0:1787852983.422661:0:8585:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787852983.422775:0:8585:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f494159c3c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d48a955-7010-4118-9c7d-f396984ae1ff:8585:1874699552330496:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787852983.426979:0:8585:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787852983.427048:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552330496 00000100:00100000:0.0:1787852983.427057:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552330496 00000100:00100000:0.0:1787852983.427115:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1787852983.427124:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f490621f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d48a955-7010-4118-9c7d-f396984ae1ff+17:8585:x1874699552330496:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787852983.427362:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f490621f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d48a955-7010-4118-9c7d-f396984ae1ff+17:8585:x1874699552330496:12345-0@lo:502:llog_process_th.0 Request processed in 238us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1787852983.427371:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1787852983.427430:0:8585:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f49065f7d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787852983.427456:0:8585:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f494159c3c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d48a955-7010-4118-9c7d-f396984ae1ff:8585:1874699552330496:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787852983.427490:0:8585:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787852983.427499:0:8585:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787852983.427501:0:8585:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1787852983.427506:0:8585:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1787852983.428347:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1787852983.428372:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787852983.428384:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f49415b8000/0x710df789068e6208 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e620f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852983.428397:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: ffff8f49415b8000/0x710df789068e6208 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e620f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787852983.428408:0:5834:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787852983.428411:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f4903010800 from 4 10000000:01000000:3.0:1787852983.428414:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787852983.428450:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f4921e21c00/0x710df789068e6216 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852983.428458:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.101@tcp lock: ffff8f4921e21c00/0x710df789068e6216 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852983.428468:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: ffff8f4921e21c00/0x710df789068e6216 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787852983.428497:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4910d13c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552330624:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787852983.428543:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787852983.428566:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f49062a3c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787852983.428619:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552330624 00000100:00100000:3.0:1787852983.428625:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552330624 00000100:00100000:3.0:1787852983.428660:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1787852983.428668:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f490621f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+17:5834:x1874699552330624:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787852983.428679:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787852983.428693:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f4921e20c00/0x710df789068e621d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x710df789068e6216 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852983.428717:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f4921e20c00/0x710df789068e621d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x710df789068e6216 expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852983.428727:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f4921e20c00/0x710df789068e621d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x710df789068e6216 expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852983.428735:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4921e20c00, rc 0) 00000100:00100000:3.0:1787852983.428768:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f490621f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+18:5834:x1874699552330624:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 101us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1787852983.428774:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1787852983.428819:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4910d13c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552330624:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787852983.428833:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: ffff8f4921e21c00/0x710df789068e6216 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e621d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787852983.439982:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: ffff8f4921e21c00/0x710df789068e6216 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x710df789068e621d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787852983.440103:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4910d13c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552330752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787852983.440178:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787852983.440228:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f49419c1e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787852983.440315:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552330752 00000100:00100000:2.0:1787852983.440322:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552330752 00000100:00100000:2.0:1787852983.440368:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1787852983.440376:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f490621d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+18:5834:x1874699552330752:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787852983.440671:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f490621d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+18:5834:x1874699552330752:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 295us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1787852983.440688:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1787852983.440733:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4910d13c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552330752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787852983.440764:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49415a6d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552330880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787852983.440797:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787852983.440810:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f4902af1780 going to sleep for 11 seconds 00000100:00100000:2.0:1787852983.440822:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552330880 00000100:00100000:2.0:1787852983.440825:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552330880 00000100:00100000:2.0:1787852983.440855:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1787852983.440863:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f490621fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d48a955-7010-4118-9c7d-f396984ae1ff+18:5834:x1874699552330880:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787852983.440987:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f490621fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d48a955-7010-4118-9c7d-f396984ae1ff+18:5834:x1874699552330880:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 125us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1787852983.440994:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1787852983.441026:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49415a6d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552330880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787852983.441223:0:8588:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49415a6d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d48a955-7010-4118-9c7d-f396984ae1ff:8588:1874699552331008:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787852983.441251:0:8588:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787852983.441267:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552331008 00000100:00100000:2.0:1787852983.441270:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552331008 00000100:00100000:2.0:1787852983.441286:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1787852983.441291:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f490621d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d48a955-7010-4118-9c7d-f396984ae1ff+18:8588:x1874699552331008:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787852983.441391:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f490621d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d48a955-7010-4118-9c7d-f396984ae1ff+18:8588:x1874699552331008:12345-0@lo:502:llog_process_th.0 Request processed in 99us (139us total) trans 0 rc 0/0 00000100:00100000:2.0:1787852983.441397:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1787852983.441421:0:8588:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f4902af1c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787852983.441430:0:8588:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49415a6d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d48a955-7010-4118-9c7d-f396984ae1ff:8588:1874699552331008:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787852983.441454:0:8588:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787852983.441463:0:8588:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787852983.441466:0:8588:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787852983.441473:0:8588:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f4903010800 00000020:00000080:2.0:1787852983.441475:0:8588:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787852983.441557:0:8588:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49415a6d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d48a955-7010-4118-9c7d-f396984ae1ff:8588:1874699552331136:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787852983.441619:0:8588:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787852983.441639:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552331136 00000100:00100000:2.0:1787852983.441642:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552331136 00000100:00100000:2.0:1787852983.441672:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1787852983.441677:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f490621e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d48a955-7010-4118-9c7d-f396984ae1ff+18:8588:x1874699552331136:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787852983.441765:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f490621e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d48a955-7010-4118-9c7d-f396984ae1ff+18:8588:x1874699552331136:12345-0@lo:502:llog_process_th.0 Request processed in 87us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1787852983.441771:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1787852983.441795:0:8588:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f4902af1c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787852983.441805:0:8588:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49415a6d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d48a955-7010-4118-9c7d-f396984ae1ff:8588:1874699552331136:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787852983.441819:0:8588:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787852983.441822:0:8588:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787852983.441824:0:8588:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1787852983.441828:0:8588:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1787852983.441868:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1787852983.441885:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787852983.441894:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f4921e21c00/0x710df789068e6216 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e621d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787852983.441904:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: ffff8f4921e21c00/0x710df789068e6216 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e621d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787852983.441923:0:5834:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787852983.441925:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f492abd6000 from 4 10000000:01000000:2.0:1787852983.441928:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787852983.441950:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f49415b9e00/0x710df789068e6224 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787852983.441959:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.101@tcp lock: ffff8f49415b9e00/0x710df789068e6224 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787852983.441968:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: ffff8f49415b9e00/0x710df789068e6224 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787852983.441979:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49415a6d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552331264:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787852983.442001:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787852983.442012:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f4902af1c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787852983.442020:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552331264 00000100:00100000:2.0:1787852983.442023:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552331264 00000100:00100000:2.0:1787852983.442039:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1787852983.442044:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f490621ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d48a955-7010-4118-9c7d-f396984ae1ff+18:5834:x1874699552331264:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787852983.442052:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787852983.442062:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f49415b8200/0x710df789068e622b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x710df789068e6224 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787852983.442081:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f49415b8200/0x710df789068e622b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x710df789068e6224 expref: 19 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787852983.442091:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f49415b8200/0x710df789068e622b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x710df789068e6224 expref: 19 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787852983.442110:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49415b8200, rc 0) 00000100:00100000:2.0:1787852983.442135:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f490621ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d48a955-7010-4118-9c7d-f396984ae1ff+19:5834:x1874699552331264:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 91us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1787852983.442141:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1787852983.442165:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49415a6d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552331264:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787852983.442175:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: ffff8f49415b9e00/0x710df789068e6224 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e622b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787852983.442183:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: ffff8f49415b9e00/0x710df789068e6224 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x710df789068e622b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787852983.442216:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49415a6d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552331392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787852983.442237:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787852983.442247:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f4902af1c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787852983.442255:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552331392 00000100:00100000:2.0:1787852983.442258:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552331392 00000100:00100000:2.0:1787852983.442273:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1787852983.442278:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4904f57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d48a955-7010-4118-9c7d-f396984ae1ff+19:5834:x1874699552331392:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787852983.442440:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4904f57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d48a955-7010-4118-9c7d-f396984ae1ff+19:5834:x1874699552331392:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 160us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1787852983.442446:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1787852983.442470:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49415a6d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552331392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787852983.442489:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49415a6d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552331520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787852983.442515:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787852983.442535:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f4902af1c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787852983.442547:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552331520 00000100:00100000:2.0:1787852983.442551:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552331520 00000100:00100000:2.0:1787852983.442594:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1787852983.442601:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4904f54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d48a955-7010-4118-9c7d-f396984ae1ff+19:5834:x1874699552331520:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787852983.442711:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4904f54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d48a955-7010-4118-9c7d-f396984ae1ff+19:5834:x1874699552331520:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 110us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1787852983.442718:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1787852983.442752:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49415a6d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552331520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787852983.455144:0:8589:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49056d9e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d48a955-7010-4118-9c7d-f396984ae1ff:8589:1874699552331648:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787852983.455242:0:8589:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787852983.455284:0:8589:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f4910a2c180 going to sleep for 11 seconds 00000100:00100000:1.0:1787852983.455317:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552331648 00000100:00100000:1.0:1787852983.455324:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552331648 00000100:00100000:1.0:1787852983.455369:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1787852983.455379:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4904f55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d48a955-7010-4118-9c7d-f396984ae1ff+19:8589:x1874699552331648:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787852983.455658:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4904f55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d48a955-7010-4118-9c7d-f396984ae1ff+19:8589:x1874699552331648:12345-0@lo:502:llog_process_th.0 Request processed in 280us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1787852983.455667:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1787852983.455786:0:8589:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49056d9e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d48a955-7010-4118-9c7d-f396984ae1ff:8589:1874699552331648:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787852983.455820:0:8589:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787852983.455830:0:8589:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787852983.455832:0:8589:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787852983.455839:0:8589:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f492abd6000 00000020:00000080:1.0:1787852983.455848:0:8589:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787852983.456270:0:8589:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49056d9e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d48a955-7010-4118-9c7d-f396984ae1ff:8589:1874699552331776:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787852983.456312:0:8589:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787852983.456343:0:8589:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f4907a486c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787852983.456373:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552331776 00000100:00100000:1.0:1787852983.456377:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552331776 00000100:00100000:1.0:1787852983.456407:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1787852983.456415:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4904f57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+19:8589:x1874699552331776:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787852983.456566:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4904f57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+19:8589:x1874699552331776:12345-0@lo:502:llog_process_th.0 Request processed in 152us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1787852983.456633:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1787852983.456674:0:8589:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49056d9e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d48a955-7010-4118-9c7d-f396984ae1ff:8589:1874699552331776:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787852983.456692:0:8589:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787852983.456697:0:8589:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787852983.456699:0:8589:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1787852983.456703:0:8589:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1787852983.456758:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1787852983.456774:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787852983.456785:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f49415b9e00/0x710df789068e6224 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e622b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787852983.456796:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: ffff8f49415b9e00/0x710df789068e6224 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e622b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787852983.533042:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49415a6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874699552331904:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787852983.533130:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787852983.533299:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f494159c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874699552332032:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787852983.533329:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787852983.533410:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552331904 00000100:00100000:0.0:1787852983.533418:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552331904 00000100:00100000:0.0:1787852983.533463:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552332032 00000100:00100000:0.0:1787852983.533466:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552332032 00000100:00100000:0.0:1787852983.533481:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787852983.533491:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4910d13840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874699552331904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787852983.533531:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787852983.533636:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4910d13840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874699552331904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 146us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1787852983.533662:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787852983.533684:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787852983.533691:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4910d103c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874699552332032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787852983.533712:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787852983.533746:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4910d103c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874699552332032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1787852983.533752:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:3.0:1787852983.533845:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f494159c3c0 x1874699552332032/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787852999 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787852983.533865:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f494159c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874699552332032:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1787852983.533898:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f49415a6d00 x1874699552331904/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787852999 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787852983.533911:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49415a6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874699552331904:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787852984.140979:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787852985.129910:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787852985.665773:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787852985.665819:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787852985.665859:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787852985.665879:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787852985.665932:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526085504 00000100:00100000:1.0:1787852985.665945:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526085504 00000100:00100000:2.0:1787852985.665956:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526085888 00000100:00100000:2.0:1787852985.665962:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526085888 00000100:00100000:1.0:1787852985.666009:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 196 00000100:00100000:2.0:1787852985.666017:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526085760 00000100:00100000:2.0:1787852985.666023:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526085760 00000100:00100000:1.0:1787852985.666023:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4904f56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af755b38-4932-400a-92cc-ddad0ca077a5+10:2365:x1874699526085504:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:2.0:1787852985.666048:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 24 00000100:00100000:2.0:1787852985.666057:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4910d12580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+5:2364:x1874699526085888:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:2.0:1787852985.666118:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4910d12580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+5:2364:x1874699526085888:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 63us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1787852985.666125:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 24 00000100:00100000:2.0:1787852985.666141:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 25 00000100:00100000:2.0:1787852985.666147:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4910d13c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+5:2365:x1874699526085760:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:2.0:1787852985.666172:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4910d13c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+5:2365:x1874699526085760:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 24us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1787852985.666178:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 25 00000100:00080000:3.0:1787852985.666230:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787852985.666234:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787852985.666409:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4904f56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af755b38-4932-400a-92cc-ddad0ca077a5+10:2365:x1874699526085504:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 389us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1787852985.666417:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 196 00000100:00100000:0.0:1787852985.671402:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526085632 00000100:00100000:0.0:1787852985.671416:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526085632 00000100:00080000:3.0:1787852985.671478:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787852985.671494:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 40 00000100:00100000:0.0:1787852985.671510:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4910d11a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+6:2364:x1874699526085632:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:0.0:1787852985.671750:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4910d11a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+6:2364:x1874699526085632:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 245us (6002us total) trans 0 rc 0/0 00000100:00100000:0.0:1787852985.671758:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 40 00010000:00010000:1.0:1787852986.157846:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787852987.188858:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787852988.138328:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49056db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5d48a955-7010-4118-9c7d-f396984ae1ff:3306:1874699552332160:0@lo:400:kworker.0 00000100:00100000:0.0:1787852988.138398:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787852988.138480:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49056dad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874699552332288:0@lo:400:kworker.0 00000100:00100000:2.0:1787852988.138551:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787852988.138638:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49056d92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874699552332800:0@lo:400:kworker.0 00000100:00100000:2.0:1787852988.138666:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787852988.139274:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552332288 00000100:00100000:2.0:1787852988.139282:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552332288 00000100:00100000:1.0:1787852988.139543:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552332160 00000100:00100000:1.0:1787852988.139548:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552332160 00000100:00100000:1.0:1787852988.139659:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1787852988.139670:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4904f51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+19:3306:x1874699552332160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787852988.139738:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4904f51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+19:3306:x1874699552332160:12345-0@lo:400:kworker.0 Request processed in 70us (1340us total) trans 0 rc 0/0 00000100:00100000:1.0:1787852988.139745:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1787852988.140020:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49056db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5d48a955-7010-4118-9c7d-f396984ae1ff:3306:1874699552332160:0@lo:400:kworker.0 00000100:00100000:3.0:1787852988.140023:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49056da580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874699552332416:0@lo:400:kworker.0 00000100:00100000:0.0:1787852988.140031:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49056d8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1874699552332672:0@lo:400:kworker.0 00000100:00100000:3.0:1787852988.140070:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787852988.140073:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787852988.140123:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787852988.140132:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49056dbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1874699552332544:0@lo:400:kworker.0 00000100:00100000:3.0:1787852988.140163:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787852988.140168:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552332800 00000100:00100000:0.0:1787852988.140173:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552332800 00000100:00100000:0.0:1787852988.140219:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552332416 00000100:00100000:0.0:1787852988.140223:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552332416 00000100:00100000:0.0:1787852988.140244:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787852988.140258:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49056dda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1874699552332800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787852988.140305:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49056dda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1874699552332800:12345-0@lo:400:kworker.0 Request processed in 48us (1638us total) trans 0 rc 0/0 00000100:00100000:0.0:1787852988.140311:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787852988.140326:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787852988.140331:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4910d112c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1874699552332416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787852988.140361:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4910d112c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1874699552332416:12345-0@lo:400:kworker.0 Request processed in 30us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1787852988.140367:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:0.0:1787852988.140382:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787852988.140386:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787852988.140654:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f49056d92c0 x1874699552332800/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787853004 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787852988.140667:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49056d92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874699552332800:0@lo:400:kworker.0 00010000:00080000:3.0:1787852988.146469:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f49056da580 x1874699552332416/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787853004 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787852988.146490:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49056da580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874699552332416:0@lo:400:kworker.0 00000100:00100000:1.0:1787852988.149302:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552332672 00000100:00100000:1.0:1787852988.149319:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552332672 00000100:00100000:2.0:1787852988.154481:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552332544 00000100:00100000:2.0:1787852988.154500:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552332544 00000100:00100000:2.0:1787852988.154623:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787852988.154638:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49056dcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874699552332288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787852988.154755:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49056dcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874699552332288:12345-0@lo:400:kworker.0 Request processed in 122us (16204us total) trans 0 rc 0/0 00000100:00100000:2.0:1787852988.154763:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787852988.154784:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787852988.154790:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49079f12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874699552332544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787852988.154828:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49079f12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874699552332544:12345-0@lo:400:kworker.0 Request processed in 38us (14666us total) trans 0 rc 0/0 00000100:00100000:2.0:1787852988.154834:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:2.0:1787852988.154857:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787852988.154909:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49056dad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874699552332288:0@lo:400:kworker.0 00000100:00100000:2.0:1787852988.154948:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49056dbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1874699552332544:0@lo:400:kworker.0 00000100:00100000:0.0:1787852988.157855:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787852988.157874:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f494159e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874699552332672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787852988.158098:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f494159e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874699552332672:12345-0@lo:400:kworker.0 Request processed in 229us (18025us total) trans 0 rc 0/0 00000100:00100000:0.0:1787852988.158107:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787852988.158217:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49056d8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1874699552332672:0@lo:400:kworker.0 00000100:00080000:2.0:1787852988.158339:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787852988.202689:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787852988.652117:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787852988.652144:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49079f1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874699552332928:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787852988.652225:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787852988.652306:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552332928 00000100:00100000:3.0:1787852988.652314:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552332928 00000100:00100000:3.0:1787852988.652365:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787852988.652374:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49079f2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874699552332928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787852988.652414:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787852988.652467:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49079f2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874699552332928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1787852988.652489:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:3.0:1787852988.652545:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f49079f1a40 x1874699552332928/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787853004 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787852988.652565:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49079f1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874699552332928:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787852988.652987:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787852988.653000:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f494159da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874699552333056:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787852988.653039:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787852988.653122:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552333056 00000100:00100000:0.0:1787852988.653128:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552333056 00000100:00100000:0.0:1787852988.653172:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787852988.653179:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49056d8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874699552333056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787852988.653200:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787852988.653249:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49056d8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874699552333056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1787852988.653255:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:1.0:1787852988.653329:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f494159da40 x1874699552333056/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787853004 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787852988.653344:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f494159da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874699552333056:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787852989.225783:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787852989.548459:0:8807:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg401-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:0.0:1787852990.256353:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787852990.783315:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787852990.786351:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787852990.788696:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526086016 00000100:00100000:0.0:1787852990.788712:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526086016 00000100:00100000:0.0:1787852990.788739:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526086144 00000100:00100000:0.0:1787852990.788743:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526086144 00000100:00100000:0.0:1787852990.794117:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 44 00000100:00100000:0.0:1787852990.794138:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49079f3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+6:2362:x1874699526086144:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:0.0:1787852990.794237:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49079f3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+6:2362:x1874699526086144:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 107us (7895us total) trans 0 rc 0/0 00000100:00100000:0.0:1787852990.794245:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 44 00000100:00100000:0.0:1787852990.794441:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 198 00000100:00100000:0.0:1787852990.794448:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4904f52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af755b38-4932-400a-92cc-ddad0ca077a5+10:2362:x1874699526086016:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:0.0:1787852990.794494:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4904f52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af755b38-4932-400a-92cc-ddad0ca077a5+10:2362:x1874699526086016:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 47us (11193us total) trans 0 rc 0/0 00000100:00100000:0.0:1787852990.794502:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 198 00000100:00080000:2.0:1787852990.798989:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787852990.800838:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787852990.800905:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787852990.801045:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526086272 00000100:00100000:1.0:1787852990.801056:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526086272 00000100:00100000:1.0:1787852990.801132:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526086400 00000100:00100000:1.0:1787852990.801136:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526086400 00000100:00100000:1.0:1787852990.801161:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 11 00000100:00100000:1.0:1787852990.801172:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f494159ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+5:2361:x1874699526086272:12345-192.168.204.1@tcp:9:kworker.0 00000020:00000080:1.0:1787852990.801213:0:6682:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x710df789068e6167 00000100:00080000:1.0:1787852990.801239:0:6682:0:(import.c:65:import_set_state_nolock()) ffff8f49415cf800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787852990.801283:0:6682:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1787852990.801966:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f494159ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+2:2361:x1874699526086272:12345-192.168.204.1@tcp:9:kworker.0 Request processed in 793us (1138us total) trans 0 rc 0/0 00000100:00100000:1.0:1787852990.801975:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 11 00000100:00100000:1.0:1787852990.801997:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 12 00000100:00100000:1.0:1787852990.802006:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f494159da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+5:2361:x1874699526086400:12345-192.168.204.1@tcp:9:kworker.0 00000020:00000080:1.0:1787852990.802024:0:6682:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x710df789068e616e 00000100:00080000:1.0:1787852990.802032:0:6682:0:(import.c:65:import_set_state_nolock()) ffff8f49415cc000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787852990.802060:0:6682:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:3.0:1787852990.803080:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787852990.803735:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787852990.803742:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787852990.805657:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787852990.805825:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f494159da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+2:2361:x1874699526086400:12345-192.168.204.1@tcp:9:kworker.0 Request processed in 3812us (4910us total) trans 0 rc 0/0 00000100:00100000:1.0:1787852990.805838:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 12 00010000:00010000:0.0:1787852991.275322:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787852992.299730:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787852993.258337:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787852993.262463:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49079f1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874699552333312:0@lo:400:kworker.0 00000100:00100000:2.0:1787852993.262629:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787852993.262758:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49079f1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5d48a955-7010-4118-9c7d-f396984ae1ff:3307:1874699552333184:0@lo:400:kworker.0 00000100:00100000:2.0:1787852993.262800:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787852993.262851:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552333312 00000100:00100000:2.0:1787852993.262858:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552333312 00000100:00100000:2.0:1787852993.262901:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787852993.262909:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49056de1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874699552333312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787852993.262967:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49056de1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874699552333312:12345-0@lo:400:kworker.0 Request processed in 58us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1787852993.262975:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787852993.263001:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552333184 00000100:00100000:2.0:1787852993.263005:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552333184 00000100:00100000:2.0:1787852993.263033:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1787852993.263040:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4904f53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+19:3307:x1874699552333184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787852993.263073:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4904f53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+19:3307:x1874699552333184:12345-0@lo:400:kworker.0 Request processed in 35us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1787852993.263080:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1787852993.263139:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49079f1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874699552333312:0@lo:400:kworker.0 00000100:00100000:2.0:1787852993.263155:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49079f1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5d48a955-7010-4118-9c7d-f396984ae1ff:3307:1874699552333184:0@lo:400:kworker.0 00000100:00100000:2.0:1787852993.263464:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49079f1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874699552333440:0@lo:400:kworker.0 00000100:00100000:3.0:1787852993.263539:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49079f1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1874699552333568:0@lo:400:kworker.0 00000100:00100000:3.0:1787852993.263616:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787852993.263634:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787852993.263667:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4920570780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1874699552333696:0@lo:400:kworker.0 00000100:00100000:3.0:1787852993.263701:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787852993.263727:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787852993.263734:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f48039f0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552333824:0@lo:400:kworker.0 00000100:00100000:3.0:1787852993.263761:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787852993.263783:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552333568 00000100:00100000:2.0:1787852993.263789:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552333568 00000100:00100000:2.0:1787852993.263834:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552333696 00000100:00100000:2.0:1787852993.263838:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552333696 00000100:00100000:2.0:1787852993.263861:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787852993.263869:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f48039f21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874699552333568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787852993.263886:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552333440 00000100:00100000:3.0:1787852993.263893:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552333440 00000100:00100000:2.0:1787852993.263921:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f48039f21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874699552333568:12345-0@lo:400:kworker.0 Request processed in 53us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1787852993.263936:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787852993.263947:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552333824 00000100:00100000:3.0:1787852993.263954:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552333824 00000100:00100000:2.0:1787852993.263955:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787852993.263966:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f48039f3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874699552333696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787852993.264007:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f48039f3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874699552333696:12345-0@lo:400:kworker.0 Request processed in 44us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1787852993.264014:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:2.0:1787852993.264037:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787852993.264042:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787852993.264046:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787852993.264080:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787852993.264090:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49056df840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1874699552333440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787852993.264135:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49056df840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1874699552333440:12345-0@lo:400:kworker.0 Request processed in 47us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1787852993.264142:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787852993.264159:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787852993.264166:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f48039f03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874699552333824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787852993.264340:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f48039f03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874699552333824:12345-0@lo:400:kworker.0 Request processed in 175us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1787852993.264348:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:2.0:1787852993.264388:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f49079f1680 x1874699552333440/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787853009 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787852993.264403:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49079f1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874699552333440:0@lo:400:kworker.0 00000100:00100000:2.0:1787852993.264442:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49079f1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1874699552333568:0@lo:400:kworker.0 00010000:00080000:3.0:1787852993.264484:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f48039f0b40 x1874699552333824/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787853009 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787852993.264496:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f48039f0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552333824:0@lo:400:kworker.0 00000100:00100000:3.0:1787852993.264509:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4920570780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1874699552333696:0@lo:400:kworker.0 00010000:00010000:3.0:1787852993.328147:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787852993.769880:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f48039f0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874699552333952:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787852993.769967:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787852993.770340:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552333952 00000100:00100000:3.0:1787852993.770348:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552333952 00000100:00100000:3.0:1787852993.770421:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787852993.770433:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f494159c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874699552333952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787852993.770471:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787852993.770523:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f494159c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874699552333952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1787852993.770532:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:0.0:1787852993.770801:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f48039f0b40 x1874699552333952/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787853009 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787852993.770833:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f48039f0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874699552333952:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787852993.772139:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f494159c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874699552334080:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787852993.772207:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787852993.772290:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552334080 00000100:00100000:3.0:1787852993.772296:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552334080 00000100:00100000:3.0:1787852993.772338:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787852993.772354:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49056dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874699552334080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787852993.772390:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787852993.776868:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49056dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874699552334080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 4502us (4647us total) trans 0 rc 0/0 00000100:00100000:3.0:1787852993.776885:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:2.0:1787852993.777524:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f494159c3c0 x1874699552334080/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787853009 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787852993.777553:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f494159c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874699552334080:0@lo:13:osp-pre-1-0.0 00000001:00100000:0.0:1787852994.324665:0:6712:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b1d98f5a-0be0-4f69-83a6-833c935c8205 00000020:00000080:0.0:1787852994.324675:0:6712:0:(genops.c:885:class_export_put()) final put ffff8f49415c8800/b1d98f5a-0be0-4f69-83a6-833c935c8205 00000020:00000080:3.0:1787852994.324737:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8f49415c8800/b1d98f5a-0be0-4f69-83a6-833c935c8205 for lustre-OST0000 00000020:00000080:3.0:1787852994.324794:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f49415cf800 for lustre-OST0000 00010000:00010000:0.0:1787852994.353609:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787852995.366367:0:7641:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b1d98f5a-0be0-4f69-83a6-833c935c8205 00000020:00000080:3.0:1787852995.366388:0:7641:0:(genops.c:885:class_export_put()) final put ffff8f49415cd800/b1d98f5a-0be0-4f69-83a6-833c935c8205 00000020:00000080:0.0:1787852995.366503:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff8f49415cd800/b1d98f5a-0be0-4f69-83a6-833c935c8205 for lustre-OST0001 00000020:00000080:0.0:1787852995.366601:0:475:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f49415cc000 for lustre-OST0001 00010000:00010000:0.0:1787852995.369979:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787852995.918426:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787852995.918473:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787852995.921322:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526086656 00000100:00100000:2.0:1787852995.921339:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526086656 00000100:00100000:2.0:1787852995.921527:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 48 00000100:00100000:2.0:1787852995.921540:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f48039f30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+6:2365:x1874699526086656:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:2.0:1787852995.921724:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f48039f30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+6:2365:x1874699526086656:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 187us (3249us total) trans 0 rc 0/0 00000100:00100000:2.0:1787852995.921732:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 48 00000100:00100000:3.0:1787852995.922030:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526086528 00000100:00100000:3.0:1787852995.922037:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526086528 00000100:00100000:3.0:1787852995.922082:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 200 00000100:00100000:3.0:1787852995.922090:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4904f53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af755b38-4932-400a-92cc-ddad0ca077a5+10:2365:x1874699526086528:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:3.0:1787852995.922136:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4904f53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af755b38-4932-400a-92cc-ddad0ca077a5+10:2365:x1874699526086528:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 48us (3725us total) trans 0 rc 0/0 00000100:00100000:3.0:1787852995.922203:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 200 00000100:00080000:3.0:1787852995.922236:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787852996.393670:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787852996.593892:0:9055:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg401-server.virtnet: executing yml_node 00010000:00010000:0.0:1787852997.420559:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787852998.379380:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f494159cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874699552334464:0@lo:400:kworker.0 00000100:00100000:1.0:1787852998.379472:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787852998.379545:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787852998.379552:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f494159c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1874699552334592:0@lo:400:kworker.0 00000100:00100000:1.0:1787852998.379617:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787852998.379854:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552334464 00000100:00100000:0.0:1787852998.379863:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552334464 00000100:00100000:0.0:1787852998.379925:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787852998.379934:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49056d9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1874699552334464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787852998.379991:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49056d9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1874699552334464:12345-0@lo:400:kworker.0 Request processed in 59us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1787852998.380011:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787852998.380266:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f494159f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5d48a955-7010-4118-9c7d-f396984ae1ff:3306:1874699552334208:0@lo:400:kworker.0 00000100:00100000:3.0:1787852998.380305:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787852998.380349:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4914199680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1874699552334720:0@lo:400:kworker.0 00000100:00100000:3.0:1787852998.380374:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787852998.380395:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787852998.380401:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f494159d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874699552334336:0@lo:400:kworker.0 00000100:00100000:3.0:1787852998.380442:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787852998.380477:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f491419ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552334848:0@lo:400:kworker.0 00000100:00100000:3.0:1787852998.380499:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787852998.380529:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552334848 00000100:00100000:3.0:1787852998.380534:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552334848 00000100:00100000:3.0:1787852998.380565:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787852998.380593:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f48039f1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1874699552334848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787852998.380844:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f48039f1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1874699552334848:12345-0@lo:400:kworker.0 Request processed in 243us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1787852998.380852:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787852998.380874:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552334592 00000100:00100000:3.0:1787852998.380878:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552334592 00000100:00100000:3.0:1787852998.380904:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552334720 00000100:00100000:3.0:1787852998.380907:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552334720 00000100:00100000:3.0:1787852998.380923:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552334336 00000100:00100000:3.0:1787852998.380926:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552334336 00000100:00100000:3.0:1787852998.380938:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787852998.380945:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49056d9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874699552334592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787852998.380976:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49056d9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874699552334592:12345-0@lo:400:kworker.0 Request processed in 32us (1359us total) trans 0 rc 0/0 00000100:00100000:3.0:1787852998.380983:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787852998.380994:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787852998.381000:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f48039f1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874699552334720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787852998.381024:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f48039f1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874699552334720:12345-0@lo:400:kworker.0 Request processed in 25us (650us total) trans 0 rc 0/0 00000100:00100000:3.0:1787852998.381030:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787852998.381040:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787852998.381054:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f48039f2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874699552334336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787852998.381079:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f48039f2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874699552334336:12345-0@lo:400:kworker.0 Request processed in 27us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1787852998.381084:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787852998.381127:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f494159d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874699552334336:0@lo:400:kworker.0 00010000:00080000:3.0:1787852998.381140:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f491419ad00 x1874699552334848/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787853014 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787852998.381151:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f491419ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552334848:0@lo:400:kworker.0 00000100:00100000:3.0:1787852998.381160:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4914199680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1874699552334720:0@lo:400:kworker.0 00000100:00080000:1.0:1787852998.381446:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787852998.381464:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787852998.381467:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787852998.381491:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f494159c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1874699552334592:0@lo:400:kworker.0 00010000:00080000:1.0:1787852998.381504:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f494159cb40 x1874699552334464/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787853014 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787852998.381513:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f494159cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874699552334464:0@lo:400:kworker.0 00000100:00100000:0.0:1787852998.381987:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552334208 00000100:00100000:0.0:1787852998.381994:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552334208 00000100:00100000:0.0:1787852998.382041:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1787852998.382050:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4904f52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+19:3306:x1874699552334208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787852998.382116:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4904f52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+19:3306:x1874699552334208:12345-0@lo:400:kworker.0 Request processed in 67us (1810us total) trans 0 rc 0/0 00000100:00100000:0.0:1787852998.382122:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1787852998.383924:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f494159f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5d48a955-7010-4118-9c7d-f396984ae1ff:3306:1874699552334208:0@lo:400:kworker.0 00010000:00010000:0.0:1787852998.444775:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787852998.892133:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f48039f2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874699552334976:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787852998.892206:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787852998.892361:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552334976 00000100:00100000:0.0:1787852998.892369:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552334976 00000100:00100000:0.0:1787852998.892422:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787852998.892445:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49056d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874699552334976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787852998.892483:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787852998.892541:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49056d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874699552334976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1787852998.892548:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:1.0:1787852998.892766:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f48039f2580 x1874699552334976/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787853014 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787852998.892785:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f48039f2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874699552334976:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787852998.893279:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f491419b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874699552335104:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787852998.893331:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787852998.893414:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552335104 00000100:00100000:0.0:1787852998.893420:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552335104 00000100:00100000:0.0:1787852998.893460:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787852998.893468:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49056df0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874699552335104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787852998.893493:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787852998.893541:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49056df0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874699552335104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1787852998.893547:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:2.0:1787852998.893665:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f491419b0c0 x1874699552335104/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787853014 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787852998.893680:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f491419b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874699552335104:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787852999.466025:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853000.504914:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787853001.028956:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853001.029030:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853001.029286:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526086912 00000100:00100000:2.0:1787853001.029301:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526086912 00000100:00100000:2.0:1787853001.029409:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 52 00000100:00100000:2.0:1787853001.029426:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f48039f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+6:2362:x1874699526086912:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:2.0:1787853001.029565:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f48039f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+6:2362:x1874699526086912:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 145us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853001.029609:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 52 00000100:00100000:1.0:1787853001.031160:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526086784 00000100:00100000:1.0:1787853001.031175:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526086784 00000100:00100000:1.0:1787853001.031251:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 202 00000100:00100000:1.0:1787853001.031261:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4904f52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af755b38-4932-400a-92cc-ddad0ca077a5+10:2362:x1874699526086784:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:1.0:1787853001.031378:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4904f52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af755b38-4932-400a-92cc-ddad0ca077a5+10:2362:x1874699526086784:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 115us (2435us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853001.031387:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 202 00000100:00080000:3.0:1787853001.034386:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787853001.514609:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787853002.009654:0:9247:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.84 00010000:00010000:2.0:1787853002.541324:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787853003.513610:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787853003.515078:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f491419b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5d48a955-7010-4118-9c7d-f396984ae1ff:3307:1874699552335232:0@lo:400:kworker.0 00000100:00100000:0.0:1787853003.515192:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853003.515527:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4914199680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874699552335360:0@lo:400:kworker.0 00000100:00100000:0.0:1787853003.515564:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853003.515668:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787853003.515677:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f492eb75e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874699552335488:0@lo:400:kworker.0 00000100:00100000:0.0:1787853003.515708:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853003.515742:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552335488 00000100:00100000:0.0:1787853003.515751:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552335488 00000100:00100000:0.0:1787853003.515817:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787853003.520650:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f492eb74780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1874699552335488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853003.520833:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f492eb74780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1874699552335488:12345-0@lo:400:kworker.0 Request processed in 222us (5122us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853003.520842:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:0.0:1787853003.521183:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f492eb75e00 x1874699552335488/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787853019 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787853003.521757:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552335232 00000100:00100000:1.0:1787853003.521768:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552335232 00000100:00100000:1.0:1787853003.521830:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1787853003.521839:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4904f51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+19:3307:x1874699552335232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853003.521909:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4904f51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+19:3307:x1874699552335232:12345-0@lo:400:kworker.0 Request processed in 72us (6719us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853003.521917:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1787853003.521990:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f491419b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5d48a955-7010-4118-9c7d-f396984ae1ff:3307:1874699552335232:0@lo:400:kworker.0 00000100:00100000:0.0:1787853003.523243:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f492eb75e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874699552335488:0@lo:400:kworker.0 00000100:00100000:0.0:1787853003.523764:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f492eb75e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1874699552335616:0@lo:400:kworker.0 00000100:00100000:0.0:1787853003.526506:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853003.527549:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552335360 00000100:00100000:1.0:1787853003.527708:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787853003.527729:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49056da1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1874699552335744:0@lo:400:kworker.0 00000100:00100000:1.0:1787853003.527808:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853003.528624:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49056d83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874699552335872:0@lo:400:kworker.0 00000100:00100000:0.0:1787853003.528722:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552335360 00000100:00100000:0.0:1787853003.528796:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552335616 00000100:00100000:0.0:1787853003.528803:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552335616 00000100:00100000:2.0:1787853003.529101:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552335744 00000100:00100000:2.0:1787853003.529107:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552335744 00000100:00100000:2.0:1787853003.529139:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787853003.529150:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f491419ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874699552335360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853003.529392:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f491419ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874699552335360:12345-0@lo:400:kworker.0 Request processed in 243us (13825us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853003.529401:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787853003.529424:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787853003.529431:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49056db840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874699552335744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853003.529462:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49056db840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874699552335744:12345-0@lo:400:kworker.0 Request processed in 32us (1654us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853003.529468:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787853003.530149:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853003.530454:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787853003.530472:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f492eb76580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874699552335616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853003.530537:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f492eb76580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874699552335616:12345-0@lo:400:kworker.0 Request processed in 75us (4046us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853003.530543:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787853003.530614:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f492eb75e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1874699552335616:0@lo:400:kworker.0 00000100:00100000:1.0:1787853003.530816:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49056da1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1874699552335744:0@lo:400:kworker.0 00000100:00080000:3.0:1787853003.531097:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787853003.531105:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787853003.531122:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552335872 00000100:00100000:3.0:1787853003.531130:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552335872 00000100:00100000:1.0:1787853003.531466:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4914199680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874699552335360:0@lo:400:kworker.0 00000100:00100000:3.0:1787853003.534781:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787853003.534811:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49056db0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1874699552335872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853003.536711:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49056db0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1874699552335872:12345-0@lo:400:kworker.0 Request processed in 1898us (6546us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853003.536733:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:3.0:1787853003.536810:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787853003.536923:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f49056d83c0 x1874699552335872/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787853019 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787853003.536946:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49056d83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874699552335872:0@lo:400:kworker.0 00010000:00010000:1.0:1787853003.565214:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787853004.009917:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f492eb75e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874699552336000:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787853004.010032:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853004.010416:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552336000 00000100:00100000:0.0:1787853004.010428:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552336000 00000100:00100000:0.0:1787853004.010508:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787853004.010521:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49056dd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874699552336000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787853004.010595:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787853004.010675:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49056dd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874699552336000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 156us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853004.010719:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:0.0:1787853004.010780:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f492eb75e00 x1874699552336000/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787853020 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787853004.010804:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f492eb75e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874699552336000:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787853004.011276:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787853004.011290:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f48039f3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874699552336128:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787853004.011347:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853004.011423:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552336128 00000100:00100000:3.0:1787853004.011430:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552336128 00000100:00100000:3.0:1787853004.011475:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787853004.011485:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49056de940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874699552336128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787853004.011517:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787853004.011609:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49056de940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874699552336128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853004.011617:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:1.0:1787853004.012019:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f48039f3c00 x1874699552336128/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787853020 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787853004.012040:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f48039f3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874699552336128:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787853004.587496:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853005.623485:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787853005.923651:0:9345:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.84 00000100:00100000:3.0:1787853006.151885:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853006.151971:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853006.152650:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526087040 00000100:00100000:0.0:1787853006.152666:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526087040 00000100:00100000:0.0:1787853006.152763:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 204 00000100:00100000:0.0:1787853006.152777:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4904f50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af755b38-4932-400a-92cc-ddad0ca077a5+10:2362:x1874699526087040:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:0.0:1787853006.152908:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4904f50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af755b38-4932-400a-92cc-ddad0ca077a5+10:2362:x1874699526087040:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 134us (1045us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853006.152916:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 204 00000100:00100000:0.0:1787853006.152969:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526087168 00000100:00100000:0.0:1787853006.152974:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526087168 00000100:00100000:0.0:1787853006.153028:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 56 00000100:00100000:0.0:1787853006.153036:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f48039f0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+6:2362:x1874699526087168:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:0.0:1787853006.153085:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f48039f0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+6:2362:x1874699526087168:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 50us (1114us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853006.153093:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 56 00000100:00080000:3.0:1787853006.155147:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787853006.633996:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787853007.660074:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787853008.618801:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4941742d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1874699552336640:0@lo:400:kworker.0 00000100:00100000:1.0:1787853008.618873:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f492eb75e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874699552336384:0@lo:400:kworker.0 00000100:00100000:0.0:1787853008.618897:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853008.618950:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4941740000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874699552336512:0@lo:400:kworker.0 00000100:00100000:3.0:1787853008.618953:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f492eb76940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5d48a955-7010-4118-9c7d-f396984ae1ff:3306:1874699552336256:0@lo:400:kworker.0 00000100:00100000:1.0:1787853008.622698:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552336640 00000100:00100000:1.0:1787853008.622722:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552336640 00000100:00100000:1.0:1787853008.622852:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787853008.622870:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4941743840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874699552336640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853008.627958:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853008.628032:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552336512 00000100:00100000:2.0:1787853008.628045:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552336512 00000100:00100000:2.0:1787853008.628137:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787853008.628150:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49056ded00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1874699552336512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853008.628495:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49056ded00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1874699552336512:12345-0@lo:400:kworker.0 Request processed in 347us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853008.628532:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:2.0:1787853008.628654:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f4941740000 x1874699552336512/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787853024 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787853008.628675:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4941740000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874699552336512:0@lo:400:kworker.0 00000100:00100000:2.0:1787853008.632953:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853008.633065:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4941741680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874699552336896:0@lo:400:kworker.0 00000100:00100000:2.0:1787853008.633160:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853008.633259:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552336384 00000100:00100000:2.0:1787853008.633269:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552336384 00000100:00100000:2.0:1787853008.633340:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787853008.633352:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49056df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874699552336384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853008.633429:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49056df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874699552336384:12345-0@lo:400:kworker.0 Request processed in 79us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853008.633438:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787853008.633501:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f492eb75e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874699552336384:0@lo:400:kworker.0 00000100:00100000:3.0:1787853008.635288:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552336896 00000100:00100000:3.0:1787853008.635311:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552336896 00000100:00100000:3.0:1787853008.635402:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787853008.635416:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49056dfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1874699552336896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853008.635532:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49056dfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1874699552336896:12345-0@lo:400:kworker.0 Request processed in 119us (2371us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853008.635540:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:3.0:1787853008.635566:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787853008.635584:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f4941741680 x1874699552336896/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787853024 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787853008.635590:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787853008.635595:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787853008.635607:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4941741680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874699552336896:0@lo:400:kworker.0 00000100:00100000:3.0:1787853008.635636:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853008.635716:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49417403c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1874699552336768:0@lo:400:kworker.0 00000100:00100000:2.0:1787853008.636227:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552336256 00000100:00100000:2.0:1787853008.636235:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552336256 00000100:00100000:2.0:1787853008.636465:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1787853008.636898:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853008.636980:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4904f50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d48a955-7010-4118-9c7d-f396984ae1ff+19:3306:x1874699552336256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853008.637048:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4904f50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d48a955-7010-4118-9c7d-f396984ae1ff+19:3306:x1874699552336256:12345-0@lo:400:kworker.0 Request processed in 574us (1411us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853008.637073:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1787853008.638128:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552336768 00000100:00100000:2.0:1787853008.638341:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552336768 00000100:00100000:2.0:1787853008.638868:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787853008.638878:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f48039f1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874699552336768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853008.639015:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f48039f1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874699552336768:12345-0@lo:400:kworker.0 Request processed in 138us (2118us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853008.639022:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:2.0:1787853008.639056:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787853008.639107:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f492eb76940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5d48a955-7010-4118-9c7d-f396984ae1ff:3306:1874699552336256:0@lo:400:kworker.0 00000100:00100000:2.0:1787853008.639135:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49417403c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1874699552336768:0@lo:400:kworker.0 00000100:00100000:1.0:1787853008.646932:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4941743840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874699552336640:12345-0@lo:400:kworker.0 Request processed in 24052us (28018us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853008.646955:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787853008.652290:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4941742d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1874699552336640:0@lo:400:kworker.0 00010000:00010000:2.0:1787853008.682304:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787853009.129872:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787853009.129907:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49056da1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874699552337024:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787853009.130018:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853009.130105:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552337024 00000100:00100000:1.0:1787853009.130125:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552337024 00000100:00100000:1.0:1787853009.130190:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787853009.130201:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49056d9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874699552337024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787853009.130252:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787853009.130327:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49056d9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874699552337024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 127us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853009.130336:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:1.0:1787853009.130383:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f49056da1c0 x1874699552337024/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787853025 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787853009.130406:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49056da1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874699552337024:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787853009.137812:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787853009.137854:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49056dc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874699552337152:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787853009.137954:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853009.138045:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552337152 00000100:00100000:2.0:1787853009.138055:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552337152 00000100:00100000:2.0:1787853009.138143:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787853009.138154:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49056dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874699552337152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787853009.138204:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787853009.138262:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49056dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874699552337152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853009.138270:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:2.0:1787853009.138325:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f49056dc780 x1874699552337152/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787853025 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787853009.138367:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49056dc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874699552337152:0@lo:13:osp-pre-1-0.0 00000001:02000400:1.0:1787853009.364064:0:9443:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.84 00010000:00010000:3.0:1787853009.707122:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787853010.730430:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787853011.264113:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853011.264160:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853011.264221:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526087296 00000100:00100000:3.0:1787853011.264231:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526087296 00000100:00100000:3.0:1787853011.264297:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 206 00000100:00100000:3.0:1787853011.264307:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4904f50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af755b38-4932-400a-92cc-ddad0ca077a5+10:2362:x1874699526087296:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:3.0:1787853011.264400:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4904f50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af755b38-4932-400a-92cc-ddad0ca077a5+10:2362:x1874699526087296:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 94us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853011.264407:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 206 00000100:00100000:2.0:1787853011.265062:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526087424 00000100:00100000:2.0:1787853011.265079:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526087424 00000100:00100000:2.0:1787853011.265149:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 60 00000100:00100000:2.0:1787853011.265158:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49056da1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+6:2362:x1874699526087424:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:2.0:1787853011.265214:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49056da1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+6:2362:x1874699526087424:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 57us (1053us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853011.265221:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 60 00000100:00080000:3.0:1787853011.265933:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:0.0:1787853011.372032:0:9491:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Thu Aug 27 13:50:09 EDT 2026 00010000:00010000:2.0:1787853011.756290:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787853012.783855:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787853013.739846:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49056de580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874699552337408:0@lo:400:kworker.0 00000100:00100000:1.0:1787853013.739929:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853013.742775:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49056dc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5d48a955-7010-4118-9c7d-f396984ae1ff:3306:1874699552337280:0@lo:400:kworker.0 00000100:00100000:3.0:1787853013.742863:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853013.743251:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49056dde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874699552337536:0@lo:400:kworker.0 00000100:00100000:2.0:1787853013.743296:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853013.743374:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552337280 00000100:00100000:0.0:1787853013.743398:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552337280 00000100:00100000:0.0:1787853013.743547:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1787853013.743715:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4904f53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+19:3306:x1874699552337280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853013.743775:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4904f53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+19:3306:x1874699552337280:12345-0@lo:400:kworker.0 Request processed in 220us (912us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853013.743783:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1787853013.744413:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f492eb76940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874699552337920:0@lo:400:kworker.0 00000100:00100000:1.0:1787853013.744537:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853013.744826:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552337408 00000100:00100000:3.0:1787853013.744835:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552337408 00000100:00100000:3.0:1787853013.744883:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787853013.744891:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49056d83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874699552337408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853013.744945:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49056d83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874699552337408:12345-0@lo:400:kworker.0 Request processed in 56us (5017us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853013.744952:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787853013.744974:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49056dcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1874699552337664:0@lo:400:kworker.0 00000100:00100000:3.0:1787853013.745002:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853013.745336:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552337664 00000100:00100000:1.0:1787853013.745342:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552337664 00000100:00100000:1.0:1787853013.745389:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787853013.745397:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f48039f0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874699552337664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853013.746790:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f48039f0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874699552337664:12345-0@lo:400:kworker.0 Request processed in 1388us (1780us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853013.746803:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787853013.746949:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49056dcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1874699552337664:0@lo:400:kworker.0 00000100:00080000:3.0:1787853013.746996:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787853013.747060:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49056de580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874699552337408:0@lo:400:kworker.0 00000100:00100000:3.0:1787853013.747103:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552337536 00000100:00100000:3.0:1787853013.747109:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552337536 00000100:00100000:3.0:1787853013.747160:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552337920 00000100:00100000:3.0:1787853013.747164:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552337920 00000100:00100000:3.0:1787853013.747184:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787853013.747191:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f492eb75e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1874699552337536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853013.747258:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f492eb75e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1874699552337536:12345-0@lo:400:kworker.0 Request processed in 67us (3960us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853013.747264:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787853013.747276:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787853013.747283:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49056d8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874699552337920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853013.747314:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49056d8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874699552337920:12345-0@lo:400:kworker.0 Request processed in 31us (2777us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853013.747320:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:3.0:1787853013.747353:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f492eb76940 x1874699552337920/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787853029 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787853013.747364:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f492eb76940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874699552337920:0@lo:400:kworker.0 00000100:00080000:1.0:1787853013.747919:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787853013.747923:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787853013.748379:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49056dc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5d48a955-7010-4118-9c7d-f396984ae1ff:3306:1874699552337280:0@lo:400:kworker.0 00000100:00100000:0.0:1787853013.748395:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49056dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1874699552337792:0@lo:400:kworker.0 00000100:00100000:0.0:1787853013.748525:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853013.748838:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552337792 00000100:00100000:3.0:1787853013.748844:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552337792 00000100:00100000:3.0:1787853013.748985:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787853013.748995:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4941742d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874699552337792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853013.749054:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4941742d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874699552337792:12345-0@lo:400:kworker.0 Request processed in 61us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853013.749061:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:1.0:1787853013.749088:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787853013.751386:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49056dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1874699552337792:0@lo:400:kworker.0 00010000:00080000:2.0:1787853013.755860:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f49056dde00 x1874699552337536/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787853029 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787853013.755882:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49056dde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874699552337536:0@lo:400:kworker.0 00010000:00010000:3.0:1787853013.802055:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787853014.249787:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787853014.251336:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49056d8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874699552338176:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787853014.251419:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853014.251550:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f492eb76940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874699552338048:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787853014.251620:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853014.251758:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552338176 00000100:00100000:2.0:1787853014.251766:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552338176 00000100:00100000:2.0:1787853014.251869:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552338048 00000100:00100000:2.0:1787853014.251873:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552338048 00000100:00100000:2.0:1787853014.251889:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787853014.251899:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49417403c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874699552338176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787853014.251947:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787853014.252218:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49417403c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874699552338176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 319us (797us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853014.252226:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787853014.252256:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787853014.252262:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4941741680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874699552338048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787853014.252280:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787853014.252305:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4941741680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874699552338048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 44us (691us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853014.252310:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:3.0:1787853014.252466:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f49056d8780 x1874699552338176/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787853030 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787853014.252485:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49056d8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874699552338176:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1787853014.252495:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f492eb76940 x1874699552338048/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787853030 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787853014.252506:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f492eb76940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874699552338048:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787853014.837260:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787853015.851043:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787853016.386364:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853016.386423:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853016.386536:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526087552 00000100:00100000:2.0:1787853016.386548:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526087552 00000100:00100000:2.0:1787853016.386657:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 208 00000100:00100000:2.0:1787853016.386669:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4904f50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af755b38-4932-400a-92cc-ddad0ca077a5+10:2365:x1874699526087552:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:2.0:1787853016.386763:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4904f50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af755b38-4932-400a-92cc-ddad0ca077a5+10:2365:x1874699526087552:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 96us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853016.386772:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 208 00000100:00100000:3.0:1787853016.386996:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526087680 00000100:00100000:3.0:1787853016.387001:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526087680 00000100:00100000:3.0:1787853016.387067:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 64 00000100:00100000:3.0:1787853016.387076:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4941740000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+6:2365:x1874699526087680:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:3.0:1787853016.387114:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4941740000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+6:2365:x1874699526087680:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 40us (690us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853016.387120:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 64 00000100:00080000:0.0:1787853016.387525:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787853016.873786:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853017.897827:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787853018.865232:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f48039f2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874699552338432:0@lo:400:kworker.0 00000100:00100000:3.0:1787853018.865330:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853018.865396:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49056dde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552338944:0@lo:400:kworker.0 00000100:00100000:3.0:1787853018.865429:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853018.865468:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787853018.865474:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f48039f0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552338560:0@lo:400:kworker.0 00000100:00100000:3.0:1787853018.865499:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853018.865537:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552338432 00000100:00100000:3.0:1787853018.865566:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552338432 00000100:00100000:3.0:1787853018.865667:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787853018.865678:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49056dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874699552338432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853018.865748:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49056dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874699552338432:12345-0@lo:400:kworker.0 Request processed in 72us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853018.865757:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787853018.865787:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552338944 00000100:00100000:3.0:1787853018.865791:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552338944 00000100:00100000:3.0:1787853018.865829:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552338560 00000100:00100000:3.0:1787853018.865833:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552338560 00000100:00100000:3.0:1787853018.865856:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787853018.865862:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49056dc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874699552338944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853018.865895:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49056dc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874699552338944:12345-0@lo:400:kworker.0 Request processed in 33us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853018.865902:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787853018.865916:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787853018.865935:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49056de580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874699552338560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853018.865967:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49056de580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874699552338560:12345-0@lo:400:kworker.0 Request processed in 33us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853018.865973:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:3.0:1787853018.865998:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787853018.866003:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787853018.866041:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f48039f0b40 x1874699552338560/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787853034 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787853018.866059:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f48039f0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552338560:0@lo:400:kworker.0 00000100:00100000:3.0:1787853018.866071:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f48039f2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874699552338432:0@lo:400:kworker.0 00010000:00080000:3.0:1787853018.866093:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f49056dde00 x1874699552338944/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787853034 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787853018.866102:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49056dde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552338944:0@lo:400:kworker.0 00000100:00100000:2.0:1787853018.866305:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f48039f12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1874699552338688:0@lo:400:kworker.0 00000100:00100000:2.0:1787853018.866347:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853018.866391:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787853018.866401:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f48039f2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5d48a955-7010-4118-9c7d-f396984ae1ff:3308:1874699552338304:0@lo:400:kworker.0 00000100:00100000:2.0:1787853018.866438:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853018.866476:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f48039f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1874699552338816:0@lo:400:kworker.0 00000100:00100000:2.0:1787853018.866501:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853018.866534:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552338304 00000100:00100000:2.0:1787853018.866538:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552338304 00000100:00100000:2.0:1787853018.866608:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1787853018.866618:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4904f53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+19:3308:x1874699552338304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853018.866666:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4904f53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+19:3308:x1874699552338304:12345-0@lo:400:kworker.0 Request processed in 51us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853018.866683:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1787853018.866715:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552338688 00000100:00100000:2.0:1787853018.866719:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552338688 00000100:00100000:2.0:1787853018.866749:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552338816 00000100:00100000:2.0:1787853018.866753:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552338816 00000100:00100000:2.0:1787853018.866776:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787853018.866783:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49079f1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874699552338688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853018.866815:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49079f1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874699552338688:12345-0@lo:400:kworker.0 Request processed in 33us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853018.866822:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787853018.866834:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787853018.866839:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49079f1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874699552338816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853018.866866:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49079f1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874699552338816:12345-0@lo:400:kworker.0 Request processed in 27us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853018.866872:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:2.0:1787853018.866894:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787853018.866917:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f48039f2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5d48a955-7010-4118-9c7d-f396984ae1ff:3308:1874699552338304:0@lo:400:kworker.0 00000100:00100000:2.0:1787853018.866942:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f48039f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1874699552338816:0@lo:400:kworker.0 00000100:00100000:2.0:1787853018.866951:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f48039f12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1874699552338688:0@lo:400:kworker.0 00010000:00010000:3.0:1787853018.922764:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787853019.371395:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787853019.371428:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49079f30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552339072:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787853019.371515:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853019.372010:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552339072 00000100:00100000:2.0:1787853019.372022:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552339072 00000100:00100000:2.0:1787853019.372079:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787853019.372089:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f492eb76940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874699552339072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787853019.372135:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787853019.372197:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f492eb76940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874699552339072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (682us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853019.372224:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:0.0:1787853019.375870:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f49079f30c0 x1874699552339072/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787853035 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787853019.375922:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49079f30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552339072:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787853019.376622:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787853019.376642:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49056dbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874699552339200:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787853019.376755:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853019.378066:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552339200 00000100:00100000:1.0:1787853019.378082:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552339200 00000100:00100000:1.0:1787853019.378167:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787853019.378178:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493beeb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874699552339200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787853019.378228:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787853019.378323:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493beeb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874699552339200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 146us (1567us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853019.378332:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:0.0:1787853019.378782:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f49056dbc00 x1874699552339200/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787853035 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787853019.378811:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49056dbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874699552339200:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787853019.945755:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853020.969750:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787853021.515535:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853021.515620:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853021.516747:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526087808 00000100:00100000:1.0:1787853021.516759:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526087808 00000100:00100000:1.0:1787853021.516819:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 210 00000100:00100000:1.0:1787853021.516828:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4904f51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af755b38-4932-400a-92cc-ddad0ca077a5+10:2363:x1874699526087808:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:1.0:1787853021.516915:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4904f51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af755b38-4932-400a-92cc-ddad0ca077a5+10:2363:x1874699526087808:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 87us (1293us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853021.516921:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 210 00000100:00100000:3.0:1787853021.517230:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526087936 00000100:00100000:3.0:1787853021.517235:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526087936 00000100:00100000:3.0:1787853021.517285:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 68 00000100:00100000:3.0:1787853021.517294:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49079f30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+6:2363:x1874699526087936:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:3.0:1787853021.517329:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49079f30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+6:2363:x1874699526087936:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 37us (1804us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853021.517335:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 68 00000100:00080000:2.0:1787853021.517515:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787853021.997030:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787853023.018735:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787853023.985890:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49056da580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5d48a955-7010-4118-9c7d-f396984ae1ff:3309:1874699552339328:0@lo:400:kworker.0 00000100:00100000:1.0:1787853023.986011:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853023.986070:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49056dbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1874699552339840:0@lo:400:kworker.0 00000100:00100000:1.0:1787853023.986099:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853023.986128:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787853023.986133:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49056dad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1874699552339712:0@lo:400:kworker.0 00000100:00100000:1.0:1787853023.986153:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853023.986179:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49056d92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874699552339456:0@lo:400:kworker.0 00000100:00100000:1.0:1787853023.986201:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853023.986216:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49056da940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552339968:0@lo:400:kworker.0 00000100:00100000:1.0:1787853023.986238:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853023.986275:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787853023.986280:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49056db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552339584:0@lo:400:kworker.0 00000100:00100000:1.0:1787853023.986304:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853023.986356:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552339328 00000100:00100000:1.0:1787853023.986366:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552339328 00000100:00100000:1.0:1787853023.986424:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1787853023.986435:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4904f52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d48a955-7010-4118-9c7d-f396984ae1ff+19:3309:x1874699552339328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853023.986506:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4904f52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d48a955-7010-4118-9c7d-f396984ae1ff+19:3309:x1874699552339328:12345-0@lo:400:kworker.0 Request processed in 72us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853023.986514:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1787853023.986998:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552339840 00000100:00100000:1.0:1787853023.987004:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552339840 00000100:00100000:1.0:1787853023.987051:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552339712 00000100:00100000:1.0:1787853023.987054:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552339712 00000100:00100000:1.0:1787853023.987069:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552339456 00000100:00100000:1.0:1787853023.987071:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552339456 00000100:00100000:1.0:1787853023.987084:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787853023.987091:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49056d8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874699552339840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853023.987134:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49056d8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874699552339840:12345-0@lo:400:kworker.0 Request processed in 44us (1034us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853023.987140:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787853023.987151:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787853023.987156:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4914199e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874699552339712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853023.987179:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4914199e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874699552339712:12345-0@lo:400:kworker.0 Request processed in 23us (1025us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853023.987185:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787853023.987194:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787853023.987200:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49141992c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874699552339456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853023.987243:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49141992c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874699552339456:12345-0@lo:400:kworker.0 Request processed in 44us (1041us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853023.987249:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787853023.987282:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552339968 00000100:00100000:1.0:1787853023.987286:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552339968 00000100:00100000:1.0:1787853023.987317:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552339584 00000100:00100000:1.0:1787853023.987320:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552339584 00000100:00080000:0.0:1787853023.989733:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787853023.989742:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787853023.989746:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787853023.989814:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49056dad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1874699552339712:0@lo:400:kworker.0 00000100:00100000:0.0:1787853023.989843:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49056da580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5d48a955-7010-4118-9c7d-f396984ae1ff:3309:1874699552339328:0@lo:400:kworker.0 00000100:00100000:0.0:1787853023.989860:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49056dbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1874699552339840:0@lo:400:kworker.0 00000100:00100000:0.0:1787853023.989934:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787853023.989949:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4914199680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874699552339968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853023.990058:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4914199680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874699552339968:12345-0@lo:400:kworker.0 Request processed in 114us (3818us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853023.990067:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787853023.990473:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787853023.990484:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f491419b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874699552339584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853023.990525:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f491419b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874699552339584:12345-0@lo:400:kworker.0 Request processed in 45us (4220us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853023.990531:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:1.0:1787853023.993009:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f49056db480 x1874699552339584/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787853039 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787853023.993038:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49056db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552339584:0@lo:400:kworker.0 00000100:00100000:1.0:1787853023.993058:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49056d92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874699552339456:0@lo:400:kworker.0 00010000:00080000:1.0:1787853023.993073:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f49056da940 x1874699552339968/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787853039 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787853023.993083:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49056da940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552339968:0@lo:400:kworker.0 00010000:00010000:3.0:1787853024.055796:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787853024.492905:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787853024.492931:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f493beea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552340096:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787853024.493011:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853024.493111:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552340096 00000100:00100000:0.0:1787853024.493120:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552340096 00000100:00100000:0.0:1787853024.493173:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787853024.493182:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493bee9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874699552340096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787853024.493232:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787853024.493281:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493bee9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874699552340096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853024.493301:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:0.0:1787853024.493348:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f493beea940 x1874699552340096/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787853040 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787853024.493367:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f493beea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552340096:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787853024.493937:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787853024.493950:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49415a6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874699552340224:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787853024.493990:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853024.494203:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552340224 00000100:00100000:2.0:1787853024.494208:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552340224 00000100:00100000:2.0:1787853024.494252:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787853024.494261:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49056dde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874699552340224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787853024.494284:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787853024.494328:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49056dde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874699552340224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853024.494334:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:3.0:1787853024.494529:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f49415a6d00 x1874699552340224/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787853040 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787853024.494546:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49415a6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874699552340224:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787853025.066716:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787853026.090297:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787853026.630346:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853026.630400:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853026.630433:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526088192 00000100:00100000:0.0:1787853026.630443:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526088192 00000100:00100000:0.0:1787853026.630503:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 72 00000100:00100000:0.0:1787853026.630513:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493beea940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+6:2363:x1874699526088192:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:0.0:1787853026.630642:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493beea940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+6:2363:x1874699526088192:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 126us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853026.630651:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 72 00000100:00080000:0.0:1787853026.630675:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787853026.635734:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526088064 00000100:00100000:1.0:1787853026.635748:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526088064 00000100:00100000:1.0:1787853026.635840:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 212 00000100:00100000:1.0:1787853026.635851:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4904f51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af755b38-4932-400a-92cc-ddad0ca077a5+10:2362:x1874699526088064:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:1.0:1787853026.635930:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4904f51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af755b38-4932-400a-92cc-ddad0ca077a5+10:2362:x1874699526088064:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 80us (5593us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853026.635955:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 212 00010000:00010000:3.0:1787853027.113844:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787853028.152548:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787853029.099835:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f493fd57840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874699552340608:0@lo:400:kworker.0 00000100:00100000:1.0:1787853029.099910:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853029.099979:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787853029.099986:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f493fd561c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874699552340480:0@lo:400:kworker.0 00000100:00100000:1.0:1787853029.100015:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853029.100034:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f493fd55680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874699552340992:0@lo:400:kworker.0 00000100:00100000:1.0:1787853029.100057:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853029.100093:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552340480 00000100:00100000:1.0:1787853029.100100:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552340480 00000100:00100000:1.0:1787853029.100147:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787853029.100157:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493fd55e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874699552340480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853029.100212:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493fd55e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874699552340480:12345-0@lo:400:kworker.0 Request processed in 56us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853029.100219:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787853029.100286:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f493fd561c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874699552340480:0@lo:400:kworker.0 00000100:00100000:0.0:1787853029.100564:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f493fd543c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1874699552340736:0@lo:400:kworker.0 00000100:00100000:0.0:1787853029.100625:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853029.100646:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787853029.100651:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f493fd54b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5d48a955-7010-4118-9c7d-f396984ae1ff:3308:1874699552340352:0@lo:400:kworker.0 00000100:00100000:0.0:1787853029.100685:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853029.100712:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f493fd570c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1874699552340864:0@lo:400:kworker.0 00000100:00100000:0.0:1787853029.100743:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853029.100771:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552340608 00000100:00100000:0.0:1787853029.100776:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552340608 00000100:00100000:0.0:1787853029.100814:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552340992 00000100:00100000:0.0:1787853029.100817:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552340992 00000100:00100000:0.0:1787853029.100856:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787853029.100863:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493fd56940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1874699552340608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853029.100900:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493fd56940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1874699552340608:12345-0@lo:400:kworker.0 Request processed in 38us (990us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853029.100907:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787853029.100920:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787853029.100932:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493fd56580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1874699552340992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853029.100961:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493fd56580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1874699552340992:12345-0@lo:400:kworker.0 Request processed in 36us (904us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853029.100968:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787853029.100990:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552340736 00000100:00100000:0.0:1787853029.100994:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552340736 00000100:00100000:0.0:1787853029.101014:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552340864 00000100:00100000:0.0:1787853029.101017:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552340864 00000100:00100000:0.0:1787853029.101032:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787853029.101038:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493beead00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874699552340736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853029.101072:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493beead00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874699552340736:12345-0@lo:400:kworker.0 Request processed in 34us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853029.101078:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787853029.101089:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787853029.101095:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493beeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874699552340864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853029.101121:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493beeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874699552340864:12345-0@lo:400:kworker.0 Request processed in 27us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853029.101127:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:0.0:1787853029.101142:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787853029.101146:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787853029.101147:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787853029.101174:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f493fd570c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1874699552340864:0@lo:400:kworker.0 00000100:00100000:0.0:1787853029.101183:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f493fd543c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1874699552340736:0@lo:400:kworker.0 00000100:00100000:2.0:1787853029.101270:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552340352 00000100:00100000:2.0:1787853029.101274:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552340352 00000100:00100000:2.0:1787853029.101299:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1787853029.101305:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4911c01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+19:3308:x1874699552340352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853029.101339:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4911c01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+19:3308:x1874699552340352:12345-0@lo:400:kworker.0 Request processed in 35us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853029.101345:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1787853029.101839:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f493fd54b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5d48a955-7010-4118-9c7d-f396984ae1ff:3308:1874699552340352:0@lo:400:kworker.0 00010000:00080000:1.0:1787853029.106630:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f493fd55680 x1874699552340992/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787853045 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787853029.106650:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f493fd55680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874699552340992:0@lo:400:kworker.0 00010000:00080000:1.0:1787853029.106681:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f493fd57840 x1874699552340608/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787853045 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787853029.106689:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f493fd57840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874699552340608:0@lo:400:kworker.0 00010000:00010000:3.0:1787853029.161762:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787853029.610170:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49415a6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874699552341120:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787853029.610255:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853029.610597:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552341120 00000100:00100000:2.0:1787853029.610606:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552341120 00000100:00100000:2.0:1787853029.610664:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787853029.610675:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493fd57840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874699552341120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787853029.610723:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787853029.610786:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493fd57840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874699552341120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 114us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853029.610800:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787853029.611280:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787853029.611300:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49031c0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874699552341248:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787853029.611348:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1787853029.611554:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f49415a6d00 x1874699552341120/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787853045 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787853029.611598:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49415a6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874699552341120:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787853029.611739:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552341248 00000100:00100000:2.0:1787853029.611744:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552341248 00000100:00100000:2.0:1787853029.611782:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787853029.611789:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49056dcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874699552341248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787853029.611814:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787853029.611866:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49056dcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874699552341248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853029.611873:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:0.0:1787853029.611992:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f49031c0780 x1874699552341248/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787853045 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787853029.612005:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49031c0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874699552341248:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787853030.186601:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787853030.623126:0:10124:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 13:50:29 (1787853029) === 00010000:00010000:3.0:1787853031.211037:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787853031.222737:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853031.222880:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526088320 00000100:00100000:0.0:1787853031.222897:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526088320 00000100:00100000:0.0:1787853031.222990:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 214 00000100:00100000:0.0:1787853031.223000:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4911c02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af755b38-4932-400a-92cc-ddad0ca077a5+10:8151:x1874699526088320:12345-192.168.204.1@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787853031.223017:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853031.223036:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f4900030000/0x710df789068e6232 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xd0a9c507938958c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853031.223076:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f4900030000/0x710df789068e6232 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c507938958c expref: 11 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853031.223088:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f4900030000/0x710df789068e6232 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c507938958c expref: 11 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853031.223097:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4900030000, rc 0) 00000100:00100000:0.0:1787853031.223185:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4911c02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af755b38-4932-400a-92cc-ddad0ca077a5+11:8151:x1874699526088320:12345-192.168.204.1@tcp:101:mount.lustre.0 Request processed in 186us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853031.223192:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 214 00000100:00100000:2.0:1787853031.235301:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853031.235440:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526088448 00000100:00100000:1.0:1787853031.235453:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526088448 00000100:00100000:1.0:1787853031.235534:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 215 00000100:00100000:1.0:1787853031.235546:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4911c01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af755b38-4932-400a-92cc-ddad0ca077a5+11:8151:x1874699526088448:12345-192.168.204.1@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787853031.237356:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4911c01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af755b38-4932-400a-92cc-ddad0ca077a5+11:8151:x1874699526088448:12345-192.168.204.1@tcp:501:mount.lustre.0 Request processed in 1799us (2059us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853031.237372:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 215 00000100:00100000:1.0:1787853031.261066:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853031.262315:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526088576 00000100:00100000:2.0:1787853031.262332:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526088576 00000100:00100000:2.0:1787853031.262541:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 216 00000100:00100000:2.0:1787853031.262554:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4911c03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af755b38-4932-400a-92cc-ddad0ca077a5+11:8151:x1874699526088576:12345-192.168.204.1@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787853031.262914:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4911c03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af755b38-4932-400a-92cc-ddad0ca077a5+11:8151:x1874699526088576:12345-192.168.204.1@tcp:503:mount.lustre.0 Request processed in 362us (1861us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853031.262933:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 216 00000100:00100000:3.0:1787853031.280643:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853031.280969:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526088704 00000100:00100000:1.0:1787853031.280983:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526088704 00000100:00100000:1.0:1787853031.281046:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 217 00000100:00100000:1.0:1787853031.281058:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4911c00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af755b38-4932-400a-92cc-ddad0ca077a5+11:8155:x1874699526088704:12345-192.168.204.1@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787853031.281796:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4911c00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af755b38-4932-400a-92cc-ddad0ca077a5+11:8155:x1874699526088704:12345-192.168.204.1@tcp:502:llog_process_th.0 Request processed in 736us (1166us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853031.281806:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 217 00000100:00100000:3.0:1787853031.312773:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853031.313307:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526088832 00000100:00100000:2.0:1787853031.313321:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526088832 00000100:00100000:2.0:1787853031.313402:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 218 00000100:00100000:2.0:1787853031.313414:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4911c00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af755b38-4932-400a-92cc-ddad0ca077a5+11:8155:x1874699526088832:12345-192.168.204.1@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787853031.313828:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4911c00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af755b38-4932-400a-92cc-ddad0ca077a5+11:8155:x1874699526088832:12345-192.168.204.1@tcp:502:llog_process_th.0 Request processed in 416us (1070us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853031.313838:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 218 00000100:00100000:2.0:1787853031.321711:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853031.329790:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526088960 00000100:00100000:0.0:1787853031.329812:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526088960 00000100:00100000:0.0:1787853031.329943:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 219 00000100:00100000:0.0:1787853031.329956:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4911c03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af755b38-4932-400a-92cc-ddad0ca077a5+11:8151:x1874699526088960:12345-192.168.204.1@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787853031.329982:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853031.330010:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f4900030c00/0x710df789068e6239 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd0a9c50793895b6 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853031.330051:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f4900030c00/0x710df789068e6239 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793895b6 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853031.330066:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f4900030c00/0x710df789068e6239 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793895b6 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853031.330077:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4900030c00, rc 0) 00000100:00100000:0.0:1787853031.330171:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4911c03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af755b38-4932-400a-92cc-ddad0ca077a5+12:8151:x1874699526088960:12345-192.168.204.1@tcp:101:mount.lustre.0 Request processed in 218us (8603us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853031.330179:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 219 00000100:00100000:3.0:1787853031.336102:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853031.338012:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526089088 00000100:00100000:1.0:1787853031.338035:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526089088 00000100:00100000:1.0:1787853031.338132:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 220 00000100:00100000:1.0:1787853031.338144:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4911c00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af755b38-4932-400a-92cc-ddad0ca077a5+12:8151:x1874699526089088:12345-192.168.204.1@tcp:256:mount.lustre.0 20000000:01000000:1.0:1787853031.338181:0:5830:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1787853031.338224:0:5830:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1787853031.338230:0:5830:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1787853031.338233:0:5830:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1787853031.338236:0:5830:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1787853031.346158:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4911c00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af755b38-4932-400a-92cc-ddad0ca077a5+12:8151:x1874699526089088:12345-192.168.204.1@tcp:256:mount.lustre.0 Request processed in 7996us (10055us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853031.346180:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 220 00000100:00100000:2.0:1787853031.349122:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853031.349395:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526089216 00000100:00100000:0.0:1787853031.349419:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526089216 00000100:00100000:0.0:1787853031.349493:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 221 00000100:00100000:0.0:1787853031.349505:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4911c01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af755b38-4932-400a-92cc-ddad0ca077a5+12:8151:x1874699526089216:12345-192.168.204.1@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787853031.349533:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853031.349558:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f4900030400/0x710df789068e6240 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd0a9c50793895bd expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853031.349635:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f4900030400/0x710df789068e6240 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793895bd expref: 13 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853031.349654:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f4900030400/0x710df789068e6240 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793895bd expref: 13 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853031.349699:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4900030400, rc 0) 00000100:00100000:0.0:1787853031.349782:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4911c01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af755b38-4932-400a-92cc-ddad0ca077a5+13:8151:x1874699526089216:12345-192.168.204.1@tcp:101:mount.lustre.0 Request processed in 278us (676us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853031.349790:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 221 00000100:00100000:3.0:1787853031.352503:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853031.352640:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526089344 00000100:00100000:1.0:1787853031.352654:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526089344 00000100:00100000:1.0:1787853031.352748:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 222 00000100:00100000:1.0:1787853031.352759:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4911c02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af755b38-4932-400a-92cc-ddad0ca077a5+13:8151:x1874699526089344:12345-192.168.204.1@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787853031.353201:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4911c02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af755b38-4932-400a-92cc-ddad0ca077a5+13:8151:x1874699526089344:12345-192.168.204.1@tcp:501:mount.lustre.0 Request processed in 442us (713us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853031.353213:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 222 00000100:00100000:3.0:1787853031.355280:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853031.355398:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526089472 00000100:00100000:1.0:1787853031.355412:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526089472 00000100:00100000:1.0:1787853031.355480:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 223 00000100:00100000:1.0:1787853031.355491:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4911c03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af755b38-4932-400a-92cc-ddad0ca077a5+13:8151:x1874699526089472:12345-192.168.204.1@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787853031.355864:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4911c03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af755b38-4932-400a-92cc-ddad0ca077a5+13:8151:x1874699526089472:12345-192.168.204.1@tcp:503:mount.lustre.0 Request processed in 374us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853031.355874:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 223 00000100:00100000:2.0:1787853031.365328:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853031.365511:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526089600 00000100:00100000:0.0:1787853031.365525:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526089600 00000100:00100000:0.0:1787853031.365631:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 224 00000100:00100000:0.0:1787853031.365643:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4911c00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af755b38-4932-400a-92cc-ddad0ca077a5+13:8161:x1874699526089600:12345-192.168.204.1@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787853031.366242:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4911c00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af755b38-4932-400a-92cc-ddad0ca077a5+13:8161:x1874699526089600:12345-192.168.204.1@tcp:502:llog_process_th.0 Request processed in 598us (926us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853031.366251:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 224 00000100:00100000:3.0:1787853031.372652:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853031.373105:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526089728 00000100:00100000:2.0:1787853031.373120:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526089728 00000100:00100000:2.0:1787853031.373202:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 225 00000100:00100000:2.0:1787853031.373214:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4911c03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af755b38-4932-400a-92cc-ddad0ca077a5+13:8161:x1874699526089728:12345-192.168.204.1@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787853031.373630:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4911c03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af755b38-4932-400a-92cc-ddad0ca077a5+13:8161:x1874699526089728:12345-192.168.204.1@tcp:502:llog_process_th.0 Request processed in 417us (992us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853031.373640:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 225 00000100:00100000:3.0:1787853031.381629:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853031.381667:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853031.381796:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526090240 00000100:00100000:1.0:1787853031.381809:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526090240 00000100:00100000:1.0:1787853031.381928:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526089856 00000100:00100000:1.0:1787853031.381933:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526089856 00000100:00100000:1.0:1787853031.381961:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 76 00000100:00100000:1.0:1787853031.381974:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f48039f3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+6:2362:x1874699526090240:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:1.0:1787853031.382107:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f48039f3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+6:2362:x1874699526090240:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 135us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853031.382116:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 76 00000100:00100000:1.0:1787853031.382138:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 10 00000100:00100000:1.0:1787853031.382142:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f48039f12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2361:x1874699526089856:12345-192.168.204.1@tcp:38:mount.lustre.0 00010000:00080000:1.0:1787853031.382172:0:5838:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-MDT0000: connection from 0ea3b4e1-e827-460f-be07-19e86dff3d79@192.168.204.1@tcp t0 exp 0000000000000000 cur 350 last 0 00000020:00000080:1.0:1787853031.382223:0:5838:0:(genops.c:1385:class_connect()) connect: client 0ea3b4e1-e827-460f-be07-19e86dff3d79, cookie 0x710df789068e6247 00000004:00100000:1.0:1787853031.382266:0:5838:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1787853031.382659:0:5838:0:(import.c:65:import_set_state_nolock()) ffff8f493fd03000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787853031.382714:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f48039f12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ea3b4e1-e827-460f-be07-19e86dff3d79+6:2361:x1874699526089856:12345-192.168.204.1@tcp:38:mount.lustre.0 Request processed in 568us (1045us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853031.382722:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 10 00000100:00080000:2.0:1787853031.384230:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787853031.395690:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853031.396144:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526090112 00000100:00100000:0.0:1787853031.396158:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526090112 00000100:00100000:0.0:1787853031.396266:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 11 00000100:00100000:0.0:1787853031.396279:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493fd561c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ea3b4e1-e827-460f-be07-19e86dff3d79+6:8151:x1874699526090112:12345-192.168.204.1@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787853031.396341:0:5838:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280 00000100:00080000:2.0:1787853031.396564:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787853031.402491:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493fd561c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ea3b4e1-e827-460f-be07-19e86dff3d79+6:8151:x1874699526090112:12345-192.168.204.1@tcp:41:mount.lustre.0 Request processed in 6195us (6821us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853031.402509:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 11 00000100:00100000:3.0:1787853031.403597:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853031.404528:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526089984 00000100:00100000:0.0:1787853031.404545:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526089984 00000100:00100000:2.0:1787853031.412264:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 12 00000100:00100000:2.0:1787853031.412291:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f48039f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ea3b4e1-e827-460f-be07-19e86dff3d79+6:0:x1874699526089984:12345-192.168.204.1@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787853031.412339:0:8462:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1787853031.412476:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f48039f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ea3b4e1-e827-460f-be07-19e86dff3d79+6:0:x1874699526089984:12345-192.168.204.1@tcp:41:mount.lustre.0 Request processed in 195us (8886us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853031.412485:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 12 00000100:00100000:1.0:1787853031.420857:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853031.421375:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526090368 00000100:00100000:3.0:1787853031.421400:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526090368 00000100:00100000:3.0:1787853031.421487:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 13 00000100:00100000:3.0:1787853031.421499:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493fd56d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ea3b4e1-e827-460f-be07-19e86dff3d79+6:8151:x1874699526090368:12345-192.168.204.1@tcp:40:mount.lustre.0 00000100:00100000:3.0:1787853031.421671:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493fd56d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ea3b4e1-e827-460f-be07-19e86dff3d79+6:8151:x1874699526090368:12345-192.168.204.1@tcp:40:mount.lustre.0 Request processed in 174us (829us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853031.421689:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 13 00000100:00100000:1.0:1787853031.429244:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853031.429478:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526090496 00000100:00100000:0.0:1787853031.429491:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526090496 00000100:00100000:0.0:1787853031.429553:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 13 00000100:00100000:0.0:1787853031.429564:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4905757850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2361:x1874699526090496:12345-192.168.204.1@tcp:8:mount.lustre.0 00010000:00080000:0.0:1787853031.429655:0:6681:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0000: connection from 0ea3b4e1-e827-460f-be07-19e86dff3d79@192.168.204.1@tcp t0 exp 0000000000000000 cur 350 last 0 00000020:00000080:0.0:1787853031.429707:0:6681:0:(genops.c:1385:class_connect()) connect: client 0ea3b4e1-e827-460f-be07-19e86dff3d79, cookie 0x710df789068e624e 00002000:00100000:0.0:1787853031.429723:0:6681:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 0ea3b4e1-e827-460f-be07-19e86dff3d79/ffff8f4934309800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113954 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787853031.429739:0:6681:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787853031.430073:0:6681:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787853031.430115:0:6681:0:(import.c:65:import_set_state_nolock()) ffff8f493430a000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787853031.430210:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4905757850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0ea3b4e1-e827-460f-be07-19e86dff3d79+6:2361:x1874699526090496:12345-192.168.204.1@tcp:8:mount.lustre.0 Request processed in 645us (979us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853031.430220:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 13 00000100:00100000:2.0:1787853031.439374:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853031.439443:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853031.439644:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526090624 00000100:00100000:1.0:1787853031.439659:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526090624 00000100:00100000:1.0:1787853031.439736:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 14 00000100:00100000:1.0:1787853031.439746:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49031c0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2361:x1874699526090624:12345-192.168.204.1@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787853031.439791:0:6684:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0001: connection from 0ea3b4e1-e827-460f-be07-19e86dff3d79@192.168.204.1@tcp t0 exp 0000000000000000 cur 350 last 0 00000020:00000080:1.0:1787853031.439832:0:6684:0:(genops.c:1385:class_connect()) connect: client 0ea3b4e1-e827-460f-be07-19e86dff3d79, cookie 0x710df789068e6255 00002000:00100000:1.0:1787853031.439848:0:6684:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 0ea3b4e1-e827-460f-be07-19e86dff3d79/ffff8f493fd07000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113954 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787853031.439864:0:6684:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787853031.440198:0:6684:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787853031.440258:0:6684:0:(import.c:65:import_set_state_nolock()) ffff8f493fd04000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787853031.440374:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49031c0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ea3b4e1-e827-460f-be07-19e86dff3d79+6:2361:x1874699526090624:12345-192.168.204.1@tcp:8:mount.lustre.0 Request processed in 627us (1017us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853031.440384:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 14 00000100:00100000:3.0:1787853031.443206:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526090752 00000100:00100000:3.0:1787853031.443227:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526090752 00000100:00100000:3.0:1787853031.443316:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 1 00000100:00100000:3.0:1787853031.443328:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49031c1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ea3b4e1-e827-460f-be07-19e86dff3d79+6:8151:x1874699526090752:12345-192.168.204.1@tcp:33:mount.lustre.0 00000004:00200000:2.0:1787853031.451890:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:2.0:1787853031.452138:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49031c1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ea3b4e1-e827-460f-be07-19e86dff3d79+6:8151:x1874699526090752:12345-192.168.204.1@tcp:33:mount.lustre.0 Request processed in 8803us (12684us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853031.452158:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 1 00010000:00010000:3.0:1787853032.234121:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787853033.263509:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787853034.218173:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f48039f0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874699552341504:0@lo:400:kworker.0 00000100:00100000:2.0:1787853034.218258:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853034.218333:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f494159fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552342016:0@lo:400:kworker.0 00000100:00100000:2.0:1787853034.218373:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853034.218404:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787853034.218410:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f48039f2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552341632:0@lo:400:kworker.0 00000100:00100000:2.0:1787853034.218429:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853034.218456:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552342016 00000100:00100000:2.0:1787853034.218462:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552342016 00000100:00100000:2.0:1787853034.218510:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552341632 00000100:00100000:2.0:1787853034.218513:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552341632 00000100:00100000:2.0:1787853034.218531:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787853034.218540:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49031c0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874699552342016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853034.218631:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49031c0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874699552342016:12345-0@lo:400:kworker.0 Request processed in 81us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853034.218638:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787853034.218654:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787853034.218659:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49031c21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874699552341632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853034.218689:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49031c21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874699552341632:12345-0@lo:400:kworker.0 Request processed in 30us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853034.218694:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:2.0:1787853034.218712:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787853034.218715:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787853034.218758:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f48039f2d00 x1874699552341632/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787853050 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787853034.218773:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f48039f2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552341632:0@lo:400:kworker.0 00010000:00080000:2.0:1787853034.218784:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f494159fc00 x1874699552342016/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787853050 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787853034.218792:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f494159fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552342016:0@lo:400:kworker.0 00000100:00100000:3.0:1787853034.218992:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552341504 00000100:00100000:3.0:1787853034.218997:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552341504 00000100:00100000:3.0:1787853034.219033:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787853034.219040:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49031c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874699552341504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853034.219080:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49031c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874699552341504:12345-0@lo:400:kworker.0 Request processed in 41us (822us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853034.219085:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787853034.219151:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f48039f03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1874699552341760:0@lo:400:kworker.0 00000100:00100000:1.0:1787853034.219182:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853034.219210:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787853034.219216:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f48039f2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5d48a955-7010-4118-9c7d-f396984ae1ff:3308:1874699552341376:0@lo:400:kworker.0 00000100:00100000:1.0:1787853034.219253:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853034.219274:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f48039f1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1874699552341888:0@lo:400:kworker.0 00000100:00100000:1.0:1787853034.219294:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853034.219320:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552341376 00000100:00100000:1.0:1787853034.219323:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552341376 00000100:00100000:1.0:1787853034.219347:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1787853034.219352:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4911c02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d48a955-7010-4118-9c7d-f396984ae1ff+19:3308:x1874699552341376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853034.219383:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4911c02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d48a955-7010-4118-9c7d-f396984ae1ff+19:3308:x1874699552341376:12345-0@lo:400:kworker.0 Request processed in 31us (131us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853034.219389:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1787853034.219418:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f48039f2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5d48a955-7010-4118-9c7d-f396984ae1ff:3308:1874699552341376:0@lo:400:kworker.0 00000100:00100000:3.0:1787853034.219513:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552341760 00000100:00100000:3.0:1787853034.219517:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552341760 00000100:00100000:3.0:1787853034.219552:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552341888 00000100:00100000:3.0:1787853034.219555:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552341888 00000100:00100000:3.0:1787853034.219591:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787853034.219597:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493fd57c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874699552341760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853034.219639:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493fd57c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874699552341760:12345-0@lo:400:kworker.0 Request processed in 42us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853034.219645:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787853034.219656:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787853034.219661:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493fd54780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874699552341888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853034.219683:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493fd54780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874699552341888:12345-0@lo:400:kworker.0 Request processed in 23us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853034.219688:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787853034.219839:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f48039f0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874699552341504:0@lo:400:kworker.0 00000100:00080000:1.0:1787853034.219903:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787853034.219924:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f48039f1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1874699552341888:0@lo:400:kworker.0 00000100:00100000:1.0:1787853034.219933:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f48039f03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1874699552341760:0@lo:400:kworker.0 00010000:00010000:3.0:1787853034.284071:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787853034.729721:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787853034.729748:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49031c03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552342144:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787853034.729845:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853034.730407:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552342144 00000100:00100000:2.0:1787853034.730415:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552342144 00000100:00100000:2.0:1787853034.730466:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787853034.730476:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49031c30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874699552342144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787853034.730511:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787853034.730564:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49031c30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874699552342144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (720us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853034.730603:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:2.0:1787853034.730660:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f49031c03c0 x1874699552342144/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787853050 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787853034.730678:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49031c03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552342144:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787853034.739266:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f494159d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874699552342272:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787853034.739339:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853034.741426:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552342272 00000100:00100000:2.0:1787853034.741439:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552342272 00000100:00100000:2.0:1787853034.741497:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787853034.741511:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f494159f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874699552342272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787853034.741552:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787853034.741672:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f494159f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874699552342272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 167us (2333us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853034.741680:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:2.0:1787853034.741722:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f494159d2c0 x1874699552342272/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787853050 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787853034.741753:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f494159d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874699552342272:0@lo:13:osp-pre-1-0.0 00000001:00100000:3.0:1787853035.300034:0:6712:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0ea3b4e1-e827-460f-be07-19e86dff3d79 00010000:00010000:3.0:1787853035.305923:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787853035.841292:0:5858:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 0ea3b4e1-e827-460f-be07-19e86dff3d79 00010000:00010000:3.0:1787853036.331442:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787853036.377802:0:7641:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0ea3b4e1-e827-460f-be07-19e86dff3d79 00000100:00100000:2.0:1787853036.865679:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853036.865718:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853036.865755:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853036.865776:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853036.865813:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853036.865843:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526090880 00000100:00100000:2.0:1787853036.865853:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526090880 00000100:00100000:2.0:1787853036.865911:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 227 00000100:00100000:2.0:1787853036.865923:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4911c01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af755b38-4932-400a-92cc-ddad0ca077a5+13:2363:x1874699526090880:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:2.0:1787853036.865997:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4911c01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af755b38-4932-400a-92cc-ddad0ca077a5+13:2363:x1874699526090880:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 77us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853036.866005:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 227 00000100:00100000:1.0:1787853036.866208:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526091264 00000100:00100000:1.0:1787853036.866213:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526091264 00000100:00100000:3.0:1787853036.866274:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526091008 00000100:00100000:1.0:1787853036.866275:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526091392 00000100:00100000:3.0:1787853036.866278:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526091008 00000100:00100000:1.0:1787853036.866278:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526091392 00000100:00100000:1.0:1787853036.866299:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 46 00000100:00100000:3.0:1787853036.866305:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526091136 00000100:00100000:3.0:1787853036.866307:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526091136 00000100:00100000:1.0:1787853036.866307:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49031c2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ea3b4e1-e827-460f-be07-19e86dff3d79+5:2363:x1874699526091264:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:3.0:1787853036.866336:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 80 00000100:00100000:3.0:1787853036.866343:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49031c1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+6:2363:x1874699526091008:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:0.0:1787853036.866528:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 47 00000100:00100000:0.0:1787853036.866538:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49031c2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0ea3b4e1-e827-460f-be07-19e86dff3d79+5:2363:x1874699526091392:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:2.0:1787853036.866612:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 81 00000100:00100000:2.0:1787853036.866621:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49031c1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ea3b4e1-e827-460f-be07-19e86dff3d79+5:2363:x1874699526091136:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:1.0:1787853036.870518:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49031c2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ea3b4e1-e827-460f-be07-19e86dff3d79+5:2363:x1874699526091264:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 4198us (4785us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853036.870535:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 46 00000100:00080000:1.0:1787853036.870602:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787853036.870608:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787853036.870611:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787853036.873664:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49031c1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+6:2363:x1874699526091008:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 7307us (7982us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853036.873682:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 80 00000100:00100000:0.0:1787853036.878008:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49031c2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0ea3b4e1-e827-460f-be07-19e86dff3d79+5:2363:x1874699526091392:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 11454us (12176us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853036.878024:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 47 00000100:00100000:2.0:1787853036.878628:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49031c1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ea3b4e1-e827-460f-be07-19e86dff3d79+5:2363:x1874699526091136:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 12003us (12846us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853036.878642:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 81 00010000:00010000:3.0:1787853037.353771:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787853038.309780:0:10320:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg401-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:3.0:1787853038.389339:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787853039.338652:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f494159cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1874699552342784:0@lo:400:kworker.0 00000100:00100000:3.0:1787853039.338760:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853039.338848:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787853039.338855:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f494159ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5d48a955-7010-4118-9c7d-f396984ae1ff:3308:1874699552342400:0@lo:400:kworker.0 00000100:00100000:3.0:1787853039.338891:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853039.338916:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f494159c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1874699552342912:0@lo:400:kworker.0 00000100:00100000:3.0:1787853039.338941:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853039.338970:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f494159da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874699552342528:0@lo:400:kworker.0 00000100:00100000:3.0:1787853039.339009:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853039.339030:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f494159d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552343040:0@lo:400:kworker.0 00000100:00100000:3.0:1787853039.339086:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853039.339253:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552342784 00000100:00100000:1.0:1787853039.339265:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552342784 00000100:00100000:1.0:1787853039.339339:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552342912 00000100:00100000:1.0:1787853039.339342:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552342912 00000100:00100000:1.0:1787853039.339359:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552342528 00000100:00100000:1.0:1787853039.339362:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552342528 00000100:00100000:1.0:1787853039.339378:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787853039.339389:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f494159d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874699552342784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853039.339455:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f494159d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874699552342784:12345-0@lo:400:kworker.0 Request processed in 68us (696us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853039.339464:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787853039.339484:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787853039.339491:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f494159fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874699552342912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853039.339533:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f494159fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874699552342912:12345-0@lo:400:kworker.0 Request processed in 31us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853039.339539:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787853039.339551:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787853039.339557:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4920570780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874699552342528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853039.339622:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4920570780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874699552342528:12345-0@lo:400:kworker.0 Request processed in 63us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853039.339630:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:1.0:1787853039.339664:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787853039.339715:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552342400 00000100:00100000:1.0:1787853039.339720:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552342400 00000100:00100000:1.0:1787853039.339760:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1787853039.339772:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4907f78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+19:3308:x1874699552342400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853039.339807:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4907f78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+19:3308:x1874699552342400:12345-0@lo:400:kworker.0 Request processed in 40us (916us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853039.339813:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1787853039.339851:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f494159f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874699552342656:0@lo:400:kworker.0 00000100:00100000:1.0:1787853039.339880:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853039.339922:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552343040 00000100:00100000:1.0:1787853039.339925:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552343040 00000100:00100000:1.0:1787853039.339964:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552342656 00000100:00100000:1.0:1787853039.339967:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552342656 00000100:00100000:1.0:1787853039.339999:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787853039.340007:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4934117840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874699552343040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853039.341273:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4934117840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874699552343040:12345-0@lo:400:kworker.0 Request processed in 1258us (2178us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853039.341286:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787853039.341324:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787853039.341338:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493fd54f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874699552342656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853039.341413:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493fd54f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874699552342656:12345-0@lo:400:kworker.0 Request processed in 81us (1531us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853039.341440:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:1.0:1787853039.341473:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787853039.341478:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787853039.341534:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f494159f840 x1874699552342656/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787853055 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787853039.341553:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f494159f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874699552342656:0@lo:400:kworker.0 00000100:00100000:1.0:1787853039.341667:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f494159ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5d48a955-7010-4118-9c7d-f396984ae1ff:3308:1874699552342400:0@lo:400:kworker.0 00000100:00100000:1.0:1787853039.341682:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f494159c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1874699552342912:0@lo:400:kworker.0 00000100:00100000:1.0:1787853039.341695:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f494159cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1874699552342784:0@lo:400:kworker.0 00010000:00080000:3.0:1787853039.350560:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f494159d680 x1874699552343040/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787853055 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787853039.350599:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f494159d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552343040:0@lo:400:kworker.0 00000100:00100000:3.0:1787853039.350673:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f494159da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874699552342528:0@lo:400:kworker.0 00010000:00010000:2.0:1787853039.408778:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787853039.850024:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787853039.850049:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49031c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552343168:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787853039.850121:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853039.850195:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552343168 00000100:00100000:2.0:1787853039.850214:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552343168 00000100:00100000:2.0:1787853039.850261:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787853039.850270:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49031c3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874699552343168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787853039.850529:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787853039.850683:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49031c3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874699552343168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 414us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853039.850692:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:0.0:1787853039.850838:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f49031c3480 x1874699552343168/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787853055 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787853039.850856:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49031c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552343168:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787853039.851401:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49341143c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874699552343296:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787853039.851454:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853039.852300:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552343296 00000100:00100000:3.0:1787853039.852314:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552343296 00000100:00100000:3.0:1787853039.852401:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787853039.852413:0:6686:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:3.0:1787853039.852416:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493bee8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874699552343296:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787853039.852437:0:6686:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00002000:00000024:3.0:1787853039.852465:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787853039.852612:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493bee8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874699552343296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 200us (1157us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853039.852620:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:0.0:1787853039.853479:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f49341143c0 x1874699552343296/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787853055 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787853039.853503:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49341143c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874699552343296:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787853040.425818:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787853041.449726:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787853041.990789:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853041.990827:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853041.990854:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853041.990877:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853041.990898:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853041.990927:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526092032 00000100:00100000:3.0:1787853041.990936:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526092032 00000100:00100000:3.0:1787853041.990986:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526091904 00000100:00100000:3.0:1787853041.990989:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526091904 00000100:00100000:3.0:1787853041.991011:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 50 00000100:00100000:3.0:1787853041.991021:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4934116940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ea3b4e1-e827-460f-be07-19e86dff3d79+5:2363:x1874699526092032:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:3.0:1787853041.991095:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4934116940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ea3b4e1-e827-460f-be07-19e86dff3d79+5:2363:x1874699526092032:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 75us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853041.991205:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526091520 00000100:00100000:1.0:1787853041.991209:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526091520 00000100:00100000:1.0:1787853041.991242:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 229 00000100:00100000:1.0:1787853041.991249:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4906231450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af755b38-4932-400a-92cc-ddad0ca077a5+13:2363:x1874699526091520:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:1.0:1787853041.991276:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4906231450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af755b38-4932-400a-92cc-ddad0ca077a5+13:2363:x1874699526091520:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 28us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853041.991283:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 229 00000100:00100000:3.0:1787853041.991342:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 50 00000100:00100000:3.0:1787853041.991356:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 51 00000100:00100000:3.0:1787853041.991362:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4934116580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ea3b4e1-e827-460f-be07-19e86dff3d79+5:2363:x1874699526091904:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:3.0:1787853041.991395:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4934116580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ea3b4e1-e827-460f-be07-19e86dff3d79+5:2363:x1874699526091904:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 34us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853041.991402:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 51 00000100:00100000:3.0:1787853041.991419:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526091776 00000100:00100000:3.0:1787853041.991423:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526091776 00000100:00100000:3.0:1787853041.991497:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526091648 00000100:00100000:3.0:1787853041.991501:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526091648 00000100:00100000:1.0:1787853041.993707:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 85 00000100:00100000:1.0:1787853041.993731:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4934115680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ea3b4e1-e827-460f-be07-19e86dff3d79+5:2363:x1874699526091776:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:1.0:1787853041.993805:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4934115680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ea3b4e1-e827-460f-be07-19e86dff3d79+5:2363:x1874699526091776:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 86us (2977us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853041.993813:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 85 00000100:00100000:1.0:1787853041.993838:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 86 00000100:00100000:1.0:1787853041.993846:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4934115e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+6:2363:x1874699526091648:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:1.0:1787853041.993876:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4934115e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+6:2363:x1874699526091648:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 31us (2999us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853041.993883:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 86 00000100:00080000:3.0:1787853041.994093:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787853041.994155:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787853041.994158:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787853042.474002:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787853043.497689:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787853044.458234:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f493beea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1874699552343808:0@lo:400:kworker.0 00000100:00100000:0.0:1787853044.458305:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853044.458364:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787853044.458370:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f493bee9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5d48a955-7010-4118-9c7d-f396984ae1ff:3308:1874699552343424:0@lo:400:kworker.0 00000100:00100000:0.0:1787853044.458401:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853044.458436:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f493beeb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1874699552343936:0@lo:400:kworker.0 00000100:00100000:0.0:1787853044.461706:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853044.461784:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f493bee8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874699552343552:0@lo:400:kworker.0 00000100:00100000:0.0:1787853044.461842:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853044.461863:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f493bee83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552344064:0@lo:400:kworker.0 00000100:00100000:0.0:1787853044.461889:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853044.461914:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787853044.461934:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f493bee8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552343680:0@lo:400:kworker.0 00000100:00100000:0.0:1787853044.461958:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853044.461992:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552343808 00000100:00100000:0.0:1787853044.462000:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552343808 00000100:00100000:0.0:1787853044.462052:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552343936 00000100:00100000:0.0:1787853044.462056:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552343936 00000100:00100000:0.0:1787853044.462071:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552343552 00000100:00100000:0.0:1787853044.462074:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552343552 00000100:00100000:0.0:1787853044.462088:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787853044.462095:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493bee8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874699552343808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853044.462151:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493bee8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874699552343808:12345-0@lo:400:kworker.0 Request processed in 55us (3846us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853044.462157:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787853044.462173:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787853044.462192:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493bee92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874699552343936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853044.462223:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493bee92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874699552343936:12345-0@lo:400:kworker.0 Request processed in 32us (3763us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853044.462229:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787853044.462241:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787853044.462247:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493beebc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874699552343552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853044.462276:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493beebc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874699552343552:12345-0@lo:400:kworker.0 Request processed in 30us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853044.462282:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787853044.462300:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552343424 00000100:00100000:0.0:1787853044.462304:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552343424 00000100:00100000:0.0:1787853044.462329:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1787853044.462336:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4906231050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+19:3308:x1874699552343424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853044.462366:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4906231050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+19:3308:x1874699552343424:12345-0@lo:400:kworker.0 Request processed in 31us (3964us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853044.462372:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1787853044.462402:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552344064 00000100:00100000:0.0:1787853044.462405:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552344064 00000100:00100000:0.0:1787853044.462441:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552343680 00000100:00100000:0.0:1787853044.462444:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552343680 00000100:00100000:0.0:1787853044.462470:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787853044.462477:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493beea580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874699552344064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853044.462506:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493beea580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874699552344064:12345-0@lo:400:kworker.0 Request processed in 30us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853044.462511:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787853044.462521:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787853044.462526:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493bee9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874699552343680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853044.462560:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493bee9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874699552343680:12345-0@lo:400:kworker.0 Request processed in 33us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853044.462566:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:0.0:1787853044.462605:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787853044.462608:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787853044.462610:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787853044.462640:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f493bee9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5d48a955-7010-4118-9c7d-f396984ae1ff:3308:1874699552343424:0@lo:400:kworker.0 00000100:00100000:0.0:1787853044.462653:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f493beeb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1874699552343936:0@lo:400:kworker.0 00000100:00100000:0.0:1787853044.462663:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f493beea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1874699552343808:0@lo:400:kworker.0 00010000:00080000:0.0:1787853044.462694:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f493bee8b40 x1874699552343680/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787853060 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787853044.462705:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f493bee8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552343680:0@lo:400:kworker.0 00000100:00100000:0.0:1787853044.462715:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f493bee8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874699552343552:0@lo:400:kworker.0 00010000:00080000:0.0:1787853044.462724:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f493bee83c0 x1874699552344064/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787853060 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787853044.462731:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f493bee83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552344064:0@lo:400:kworker.0 00010000:00010000:3.0:1787853044.523341:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787853044.969991:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4934117480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874699552344192:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787853044.970064:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853044.970244:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552344192 00000100:00100000:3.0:1787853044.970251:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552344192 00000100:00100000:3.0:1787853044.970310:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787853044.970319:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493bee83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874699552344192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787853044.970354:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787853044.970428:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493bee83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874699552344192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853044.970435:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:1.0:1787853044.970532:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f4934117480 x1874699552344192/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787853060 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787853044.970552:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4934117480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874699552344192:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787853044.970992:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49031c2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874699552344320:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787853044.971027:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853044.971197:0:10348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552344320 00000100:00100000:1.0:1787853044.971202:0:10348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552344320 00000100:00100000:1.0:1787853044.971237:0:10348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787853044.971245:0:10348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493bee8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874699552344320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787853044.971269:0:10348:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787853044.971312:0:10348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493bee8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874699552344320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853044.971319:0:10348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:0.0:1787853044.971486:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f49031c2d00 x1874699552344320/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787853060 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787853044.971511:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49031c2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874699552344320:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787853045.547374:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787853046.573728:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787853047.110732:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853047.110786:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853047.110832:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526092288 00000100:00100000:3.0:1787853047.110846:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526092288 00000100:00100000:3.0:1787853047.110938:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 90 00000100:00100000:3.0:1787853047.110952:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4934117c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+6:2365:x1874699526092288:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:3.0:1787853047.111083:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4934117c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+6:2365:x1874699526092288:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 135us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853047.111126:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 90 00000100:00080000:3.0:1787853047.111154:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787853047.111428:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526092160 00000100:00100000:2.0:1787853047.111435:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526092160 00000100:00100000:2.0:1787853047.111482:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 231 00000100:00100000:2.0:1787853047.111491:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4906230850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af755b38-4932-400a-92cc-ddad0ca077a5+13:2365:x1874699526092160:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:2.0:1787853047.111528:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4906230850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af755b38-4932-400a-92cc-ddad0ca077a5+13:2365:x1874699526092160:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 39us (814us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853047.111536:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 231 00000100:00100000:3.0:1787853047.114750:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853047.114800:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853047.114832:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853047.114918:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526092416 00000100:00100000:2.0:1787853047.114930:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526092416 00000100:00100000:2.0:1787853047.115018:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 91 00000100:00100000:2.0:1787853047.115028:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4934114780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ea3b4e1-e827-460f-be07-19e86dff3d79+5:2364:x1874699526092416:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:2.0:1787853047.115134:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4934114780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ea3b4e1-e827-460f-be07-19e86dff3d79+5:2364:x1874699526092416:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 107us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853047.115142:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 91 00000100:00080000:3.0:1787853047.115292:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787853047.118183:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526092544 00000100:00100000:0.0:1787853047.118207:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526092544 00000100:00100000:0.0:1787853047.118345:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526092672 00000100:00100000:0.0:1787853047.118349:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526092672 00000100:00100000:2.0:1787853047.118406:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 54 00000100:00100000:2.0:1787853047.118420:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49341152c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0ea3b4e1-e827-460f-be07-19e86dff3d79+5:2364:x1874699526092544:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:2.0:1787853047.118534:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49341152c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0ea3b4e1-e827-460f-be07-19e86dff3d79+5:2364:x1874699526092544:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 116us (3732us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853047.118589:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 54 00000100:00100000:0.0:1787853047.124399:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 55 00000100:00100000:0.0:1787853047.124424:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4934114f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ea3b4e1-e827-460f-be07-19e86dff3d79+5:2364:x1874699526092672:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:0.0:1787853047.124536:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4934114f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ea3b4e1-e827-460f-be07-19e86dff3d79+5:2364:x1874699526092672:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 123us (9702us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853047.125073:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 55 00000100:00080000:3.0:1787853047.126792:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787853047.126805:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787853047.596950:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853048.618071:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787853049.583656:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49031c03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874699552344576:0@lo:400:kworker.0 00000100:00100000:2.0:1787853049.583728:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853049.583888:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787853049.583902:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49031c3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5d48a955-7010-4118-9c7d-f396984ae1ff:3308:1874699552344448:0@lo:400:kworker.0 00000100:00100000:3.0:1787853049.587463:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787853049.587488:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4934114000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1874699552344832:0@lo:400:kworker.0 00000100:00100000:1.0:1787853049.587638:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4934115a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874699552344704:0@lo:400:kworker.0 00000100:00100000:0.0:1787853049.589700:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853049.589812:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552344448 00000100:00100000:0.0:1787853049.589822:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552344448 00000100:00100000:0.0:1787853049.589877:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1787853049.589886:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4906232c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d48a955-7010-4118-9c7d-f396984ae1ff+19:3308:x1874699552344448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853049.589951:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4906232c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d48a955-7010-4118-9c7d-f396984ae1ff+19:3308:x1874699552344448:12345-0@lo:400:kworker.0 Request processed in 65us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853049.589958:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1787853049.590017:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49031c3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5d48a955-7010-4118-9c7d-f396984ae1ff:3308:1874699552344448:0@lo:400:kworker.0 00000100:00100000:2.0:1787853049.590264:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552344576 00000100:00100000:2.0:1787853049.590269:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552344576 00000100:00100000:2.0:1787853049.590310:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787853049.590318:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49031c12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874699552344576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853049.590376:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49031c12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874699552344576:12345-0@lo:400:kworker.0 Request processed in 60us (6648us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853049.590382:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787853049.590415:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49031c03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874699552344576:0@lo:400:kworker.0 00000100:00100000:2.0:1787853049.591368:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49031c0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552345088:0@lo:400:kworker.0 00000100:00100000:2.0:1787853049.591415:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853049.591447:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552345088 00000100:00100000:2.0:1787853049.591451:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552345088 00000100:00100000:2.0:1787853049.591499:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787853049.591518:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49031c3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874699552345088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853049.591559:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49031c3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874699552345088:12345-0@lo:400:kworker.0 Request processed in 53us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853049.591566:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:2.0:1787853049.591620:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f49031c0780 x1874699552345088/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787853065 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787853049.591642:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49031c0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552345088:0@lo:400:kworker.0 00000100:00100000:0.0:1787853049.592782:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787853049.592801:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49031c03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1874699552344960:0@lo:400:kworker.0 00000100:00100000:0.0:1787853049.592852:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853049.593066:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552344960 00000100:00100000:2.0:1787853049.593086:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552344960 00000100:00100000:2.0:1787853049.593145:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787853049.593154:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493beea1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874699552344960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853049.593207:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493beea1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874699552344960:12345-0@lo:400:kworker.0 Request processed in 55us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853049.593214:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787853049.593358:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49031c03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1874699552344960:0@lo:400:kworker.0 00000100:00080000:2.0:1787853049.594796:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787853049.594805:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787853049.595544:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853049.596801:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552344832 00000100:00100000:2.0:1787853049.596812:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552344832 00000100:00100000:2.0:1787853049.596894:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1787853049.596903:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4934114b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874699552344832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853049.596983:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4934114b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874699552344832:12345-0@lo:400:kworker.0 Request processed in 81us (1445us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853049.596991:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:0.0:1787853049.597061:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787853049.598506:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4934114000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1874699552344832:0@lo:400:kworker.0 00000100:00100000:1.0:1787853049.599043:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853049.599276:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552344704 00000100:00100000:0.0:1787853049.599283:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552344704 00000100:00100000:0.0:1787853049.599361:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787853049.599369:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493fd55680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1874699552344704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853049.599440:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493fd55680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1874699552344704:12345-0@lo:400:kworker.0 Request processed in 72us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853049.599447:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:2.0:1787853049.599508:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787853049.599618:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f4934115a40 x1874699552344704/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787853065 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787853049.599793:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4934115a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874699552344704:0@lo:400:kworker.0 00010000:00010000:3.0:1787853049.644753:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787853050.097177:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49031c0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874699552345344:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787853050.097257:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853050.097359:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552345344 00000100:00100000:2.0:1787853050.097369:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552345344 00000100:00100000:2.0:1787853050.097422:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787853050.097433:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49031c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874699552345344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787853050.097476:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787853050.097530:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49031c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874699552345344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853050.097536:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:2.0:1787853050.097596:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f49031c0780 x1874699552345344/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787853066 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787853050.097611:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f493fd543c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874699552345216:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787853050.097623:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49031c0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874699552345344:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787853050.097642:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853050.097681:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552345216 00000100:00100000:3.0:1787853050.097685:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552345216 00000100:00100000:3.0:1787853050.097710:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787853050.097717:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4934115a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874699552345216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787853050.097737:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787853050.097771:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4934115a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874699552345216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 55us (128us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853050.097777:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:3.0:1787853050.097801:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f493fd543c0 x1874699552345216/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787853066 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787853050.097822:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f493fd543c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874699552345216:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787853050.676019:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853051.694470:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787853052.224864:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853052.224915:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853052.224940:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853052.224967:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853052.224991:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853052.225139:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526092800 00000100:00100000:2.0:1787853052.225150:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526092800 00000100:00100000:2.0:1787853052.225280:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 233 00000100:00100000:2.0:1787853052.225291:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4906233c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af755b38-4932-400a-92cc-ddad0ca077a5+13:2365:x1874699526092800:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:2.0:1787853052.225360:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4906233c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af755b38-4932-400a-92cc-ddad0ca077a5+13:2365:x1874699526092800:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 71us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853052.225368:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 233 00000100:00100000:2.0:1787853052.225403:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526092928 00000100:00100000:2.0:1787853052.225407:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526092928 00000100:00100000:2.0:1787853052.225441:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526093056 00000100:00100000:2.0:1787853052.225444:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526093056 00000100:00100000:2.0:1787853052.225469:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 95 00000100:00100000:2.0:1787853052.225476:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49031c0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+6:2365:x1874699526092928:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:2.0:1787853052.225509:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49031c0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+6:2365:x1874699526092928:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 33us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853052.225517:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 95 00000100:00100000:2.0:1787853052.225532:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 96 00000100:00100000:2.0:1787853052.225539:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49031c03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ea3b4e1-e827-460f-be07-19e86dff3d79+5:2365:x1874699526093056:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:2.0:1787853052.225562:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49031c03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ea3b4e1-e827-460f-be07-19e86dff3d79+5:2365:x1874699526093056:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 25us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853052.225593:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 96 00000100:00100000:2.0:1787853052.225613:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526093184 00000100:00100000:2.0:1787853052.225617:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526093184 00000100:00100000:2.0:1787853052.225645:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526093312 00000100:00100000:2.0:1787853052.225648:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526093312 00000100:00100000:2.0:1787853052.225667:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 15 00000100:00100000:2.0:1787853052.225675:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f48039f03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0ea3b4e1-e827-460f-be07-19e86dff3d79+5:2361:x1874699526093184:12345-192.168.204.1@tcp:9:kworker.0 00000020:00000080:2.0:1787853052.225699:0:6681:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x710df789068e624e 00000100:00080000:2.0:1787853052.225710:0:6681:0:(import.c:65:import_set_state_nolock()) ffff8f493430a000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787853052.225759:0:6681:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1787853052.226209:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 16 00000100:00100000:1.0:1787853052.226222:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f48039f1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ea3b4e1-e827-460f-be07-19e86dff3d79+5:2361:x1874699526093312:12345-192.168.204.1@tcp:9:kworker.0 00000020:00000080:1.0:1787853052.226239:0:6682:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x710df789068e6255 00000100:00080000:1.0:1787853052.226246:0:6682:0:(import.c:65:import_set_state_nolock()) ffff8f493fd04000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787853052.226289:0:6682:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1787853052.226595:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f48039f1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ea3b4e1-e827-460f-be07-19e86dff3d79+2:2361:x1874699526093312:12345-192.168.204.1@tcp:9:kworker.0 Request processed in 377us (1602us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853052.226605:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 16 00010000:00010000:1.0:1787853052.226637:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787853052.227248:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f48039f03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0ea3b4e1-e827-460f-be07-19e86dff3d79+2:2361:x1874699526093184:12345-192.168.204.1@tcp:9:kworker.0 Request processed in 1572us (2280us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853052.227257:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 15 00000100:00080000:2.0:1787853052.228317:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787853052.228324:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787853052.228327:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787853052.228352:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853052.720296:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853053.738206:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787853054.698134:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f493fd55a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1874699552345856:0@lo:400:kworker.0 00000100:00100000:3.0:1787853054.698203:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853054.698285:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787853054.698291:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f493fd54b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5d48a955-7010-4118-9c7d-f396984ae1ff:3308:1874699552345472:0@lo:400:kworker.0 00000100:00100000:3.0:1787853054.698322:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853054.698346:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f493fd543c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1874699552345984:0@lo:400:kworker.0 00000100:00100000:3.0:1787853054.698365:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853054.698390:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f493fd54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874699552345728:0@lo:400:kworker.0 00000100:00100000:3.0:1787853054.698703:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853054.698728:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787853054.698734:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f493fd570c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874699552345600:0@lo:400:kworker.0 00000100:00100000:3.0:1787853054.698759:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853054.699083:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f493fd56940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874699552346112:0@lo:400:kworker.0 00000100:00100000:1.0:1787853054.699200:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552345856 00000100:00100000:1.0:1787853054.699209:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552345856 00000100:00100000:1.0:1787853054.699282:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552345984 00000100:00100000:1.0:1787853054.699286:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552345984 00000100:00100000:1.0:1787853054.699301:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552345600 00000100:00100000:1.0:1787853054.699304:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552345600 00000100:00100000:1.0:1787853054.699319:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787853054.699327:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49341161c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874699552345856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853054.699390:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49341161c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874699552345856:12345-0@lo:400:kworker.0 Request processed in 63us (1187us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853054.699398:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787853054.699416:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787853054.699422:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4934114000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874699552345984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853054.699465:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4934114000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874699552345984:12345-0@lo:400:kworker.0 Request processed in 43us (1098us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853054.699471:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787853054.699483:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787853054.699490:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4934116d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874699552345600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853054.699517:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4934116d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874699552345600:12345-0@lo:400:kworker.0 Request processed in 28us (757us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853054.699523:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787853054.699565:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552345472 00000100:00100000:1.0:1787853054.699593:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552345472 00000100:00100000:1.0:1787853054.699617:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1787853054.699623:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4906231c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+19:3308:x1874699552345472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853054.699655:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4906231c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+19:3308:x1874699552345472:12345-0@lo:400:kworker.0 Request processed in 32us (1333us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853054.699676:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1787853054.699720:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552345728 00000100:00100000:1.0:1787853054.699724:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552345728 00000100:00100000:1.0:1787853054.699750:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787853054.699758:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4934117480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1874699552345728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853054.699795:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4934117480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1874699552345728:12345-0@lo:400:kworker.0 Request processed in 38us (1092us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853054.699801:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787853054.700022:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1787853054.700071:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f493fd54000 x1874699552345728/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787853070 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787853054.700086:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f493fd54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874699552345728:0@lo:400:kworker.0 00000100:00080000:2.0:1787853054.700233:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787853054.700239:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787853054.700257:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552346112 00000100:00100000:2.0:1787853054.700260:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552346112 00000100:00100000:2.0:1787853054.700304:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787853054.700311:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49341170c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1874699552346112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853054.700354:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49341170c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1874699552346112:12345-0@lo:400:kworker.0 Request processed in 44us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853054.700360:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:2.0:1787853054.700378:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787853054.700406:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f493fd54b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5d48a955-7010-4118-9c7d-f396984ae1ff:3308:1874699552345472:0@lo:400:kworker.0 00000100:00100000:2.0:1787853054.700431:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f493fd543c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1874699552345984:0@lo:400:kworker.0 00000100:00100000:2.0:1787853054.700441:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f493fd55a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1874699552345856:0@lo:400:kworker.0 00000100:00100000:3.0:1787853054.701213:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f493fd570c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874699552345600:0@lo:400:kworker.0 00010000:00080000:3.0:1787853054.701239:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f493fd56940 x1874699552346112/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787853070 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787853054.701250:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f493fd56940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874699552346112:0@lo:400:kworker.0 00010000:00010000:1.0:1787853054.762025:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787853055.209764:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787853055.209788:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f48039f2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552346240:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787853055.209855:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853055.209925:0:10348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552346240 00000100:00100000:2.0:1787853055.209933:0:10348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552346240 00000100:00100000:2.0:1787853055.209983:0:10348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787853055.209992:0:10348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f48039f2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874699552346240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787853055.210027:0:10348:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787853055.210072:0:10348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f48039f2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874699552346240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853055.210079:0:10348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:2.0:1787853055.210308:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f48039f2580 x1874699552346240/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787853071 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787853055.210327:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f48039f2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552346240:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787853055.222243:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49341143c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874699552346368:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787853055.222314:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853055.222499:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552346368 00000100:00100000:3.0:1787853055.222512:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552346368 00000100:00100000:3.0:1787853055.222608:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787853055.222621:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f48039f2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874699552346368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787853055.222675:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787853055.222775:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f48039f2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874699552346368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 157us (460us total) trans 0 rc 0/0 00010000:00080000:2.0:1787853055.222848:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f49341143c0 x1874699552346368/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787853071 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787853055.222874:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49341143c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874699552346368:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787853055.223901:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00010000:2.0:1787853055.786701:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787853055.795320:0:6712:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0ea3b4e1-e827-460f-be07-19e86dff3d79 00000020:00000080:3.0:1787853055.795330:0:6712:0:(genops.c:885:class_export_put()) final put ffff8f4934309800/0ea3b4e1-e827-460f-be07-19e86dff3d79 00000020:00000080:0.0:1787853055.795426:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f4934309800/0ea3b4e1-e827-460f-be07-19e86dff3d79 for lustre-OST0000 00000020:00000080:0.0:1787853055.795564:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f493430a000 for lustre-OST0000 00010000:00010000:0.0:1787853056.813466:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787853056.842462:0:7641:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0ea3b4e1-e827-460f-be07-19e86dff3d79 00000020:00000080:3.0:1787853056.842473:0:7641:0:(genops.c:885:class_export_put()) final put ffff8f493fd07000/0ea3b4e1-e827-460f-be07-19e86dff3d79 00000020:00000080:0.0:1787853056.844560:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f493fd07000/0ea3b4e1-e827-460f-be07-19e86dff3d79 for lustre-OST0001 00000020:00000080:3.0:1787853056.846069:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f493fd04000 for lustre-OST0001 00000100:00100000:2.0:1787853057.343692:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853057.343729:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853057.343820:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853057.343961:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526093440 00000100:00100000:0.0:1787853057.343972:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526093440 00000100:00100000:0.0:1787853057.344043:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 235 00000100:00100000:0.0:1787853057.344055:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4911c02850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af755b38-4932-400a-92cc-ddad0ca077a5+13:2362:x1874699526093440:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:0.0:1787853057.344135:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4911c02850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af755b38-4932-400a-92cc-ddad0ca077a5+13:2362:x1874699526093440:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 83us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853057.344144:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 235 00000100:00100000:3.0:1787853057.344686:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526093696 00000100:00100000:3.0:1787853057.344693:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526093696 00000100:00100000:3.0:1787853057.344759:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526093568 00000100:00100000:3.0:1787853057.344762:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526093568 00000100:00100000:3.0:1787853057.344811:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 100 00000100:00100000:3.0:1787853057.344820:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f48039f0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ea3b4e1-e827-460f-be07-19e86dff3d79+5:2362:x1874699526093696:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:3.0:1787853057.344867:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f48039f0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ea3b4e1-e827-460f-be07-19e86dff3d79+5:2362:x1874699526093696:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 50us (1137us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853057.344875:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 100 00000100:00100000:3.0:1787853057.344890:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 101 00000100:00100000:3.0:1787853057.344896:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493c5a5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+6:2362:x1874699526093568:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:3.0:1787853057.344918:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493c5a5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+6:2362:x1874699526093568:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 22us (1099us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853057.344937:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 101 00000100:00080000:2.0:1787853057.345290:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787853057.835089:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787853058.736536:0:11025:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1787853058.859015:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787853059.819480:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f493bee9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874699552346624:0@lo:400:kworker.0 00000100:00100000:0.0:1787853059.819606:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853059.819682:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4904cd7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552347136:0@lo:400:kworker.0 00000100:00100000:0.0:1787853059.819738:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853059.819782:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787853059.819788:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4941742940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552346752:0@lo:400:kworker.0 00000100:00100000:0.0:1787853059.819813:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853059.819852:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552346624 00000100:00100000:0.0:1787853059.819863:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552346624 00000100:00100000:0.0:1787853059.819930:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787853059.819941:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4904cd6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874699552346624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853059.820012:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4904cd6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874699552346624:12345-0@lo:400:kworker.0 Request processed in 73us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853059.820020:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787853059.820049:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552347136 00000100:00100000:0.0:1787853059.820053:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552347136 00000100:00100000:3.0:1787853059.820248:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4941740780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1874699552346880:0@lo:400:kworker.0 00000100:00100000:3.0:1787853059.820288:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853059.820324:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552346752 00000100:00100000:0.0:1787853059.820329:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552346752 00000100:00100000:1.0:1787853059.820412:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f493beeb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5d48a955-7010-4118-9c7d-f396984ae1ff:3309:1874699552346496:0@lo:400:kworker.0 00000100:00100000:1.0:1787853059.820457:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853059.820493:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4941741a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1874699552347008:0@lo:400:kworker.0 00000100:00100000:1.0:1787853059.820533:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552346496 00000100:00100000:1.0:1787853059.820538:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552346496 00000100:00080000:3.0:1787853059.829603:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787853059.829619:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787853059.829652:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552346880 00000100:00100000:3.0:1787853059.829670:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552346880 00000100:00100000:3.0:1787853059.829773:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787853059.829788:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49341143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874699552346880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853059.829926:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49341143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874699552346880:12345-0@lo:400:kworker.0 Request processed in 143us (9636us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853059.829934:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787853059.830104:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787853059.830130:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4904cd6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1874699552347136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853059.830180:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4904cd6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1874699552347136:12345-0@lo:400:kworker.0 Request processed in 65us (10440us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853059.830187:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787853059.830210:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787853059.830217:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4904cd6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1874699552346752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853059.830252:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4904cd6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1874699552346752:12345-0@lo:400:kworker.0 Request processed in 35us (10438us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853059.830258:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787853059.830313:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853059.830375:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552347008 00000100:00100000:0.0:1787853059.830397:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552347008 00000100:00100000:0.0:1787853059.830428:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787853059.830436:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4921694000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874699552347008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853059.830474:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4921694000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874699552347008:12345-0@lo:400:kworker.0 Request processed in 40us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853059.830480:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787853059.830534:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4941741a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1874699552347008:0@lo:400:kworker.0 00000100:00100000:0.0:1787853059.830627:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4941740780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1874699552346880:0@lo:400:kworker.0 00010000:00080000:0.0:1787853059.830663:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f4941742940 x1874699552346752/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787853075 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787853059.830676:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4941742940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552346752:0@lo:400:kworker.0 00000100:00100000:0.0:1787853059.830690:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f493bee9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874699552346624:0@lo:400:kworker.0 00010000:00080000:0.0:1787853059.830702:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f4904cd7840 x1874699552347136/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787853075 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787853059.830710:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4904cd7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552347136:0@lo:400:kworker.0 00000100:00080000:0.0:1787853059.830751:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787853059.833420:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1787853059.833449:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4906232050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+19:3309:x1874699552346496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853059.833606:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4906232050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+19:3309:x1874699552346496:12345-0@lo:400:kworker.0 Request processed in 170us (13147us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853059.833615:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1787853059.833689:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f493beeb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5d48a955-7010-4118-9c7d-f396984ae1ff:3309:1874699552346496:0@lo:400:kworker.0 00010000:00010000:3.0:1787853059.887905:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787853060.329877:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f493c5a6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874699552347264:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787853060.329983:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853060.330140:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552347264 00000100:00100000:2.0:1787853060.330150:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552347264 00000100:00100000:2.0:1787853060.330224:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787853060.330236:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493c5a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874699552347264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787853060.330289:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787853060.330344:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493c5a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874699552347264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853060.330352:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:2.0:1787853060.330407:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f493c5a6d00 x1874699552347264/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787853076 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787853060.330433:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f493c5a6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874699552347264:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787853060.330975:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787853060.330990:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f493fd552c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874699552347392:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787853060.331040:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853060.331362:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552347392 00000100:00100000:2.0:1787853060.331370:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552347392 00000100:00100000:2.0:1787853060.331458:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787853060.331468:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493fd57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874699552347392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787853060.331500:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787853060.331564:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493fd57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874699552347392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853060.331590:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:3.0:1787853060.333201:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f493fd552c0 x1874699552347392/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787853076 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787853060.333234:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f493fd552c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874699552347392:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787853060.908038:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853061.931096:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787853062.464744:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853062.466707:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853062.467024:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526093952 00000100:00100000:2.0:1787853062.467049:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526093952 00000100:00100000:2.0:1787853062.467141:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 105 00000100:00100000:2.0:1787853062.467154:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4921696d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+6:2363:x1874699526093952:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:2.0:1787853062.467238:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4921696d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+6:2363:x1874699526093952:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 87us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853062.467246:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 105 00000100:00080000:0.0:1787853062.467959:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787853062.470752:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526093824 00000100:00100000:1.0:1787853062.470769:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526093824 00000100:00100000:1.0:1787853062.470987:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 237 00000100:00100000:1.0:1787853062.470999:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4906232850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af755b38-4932-400a-92cc-ddad0ca077a5+13:2363:x1874699526093824:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:1.0:1787853062.471114:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4906232850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af755b38-4932-400a-92cc-ddad0ca077a5+13:2363:x1874699526093824:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 117us (6385us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853062.471121:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 237 00000100:00100000:0.0:1787853062.472225:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853062.472316:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526094080 00000100:00100000:1.0:1787853062.472323:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526094080 00000100:00100000:1.0:1787853062.472447:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 106 00000100:00100000:1.0:1787853062.472456:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4921695680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ea3b4e1-e827-460f-be07-19e86dff3d79+5:2362:x1874699526094080:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:1.0:1787853062.472532:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4921695680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ea3b4e1-e827-460f-be07-19e86dff3d79+5:2362:x1874699526094080:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 77us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853062.472539:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 106 00000100:00080000:0.0:1787853062.472976:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:3.0:1787853062.768234:0:11173:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd76b69c70 20000000:00000080:3.0:1787853062.768257:0:11173:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8f493fe1c400 uarg=0000000000000000 20000000:01000000:3.0:1787853062.768300:0:11173:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787853062.768306:0:11173:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787853062.768311:0:11173:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1787853062.769925:0:11174:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:1.0:1787853062.770268:0:11173:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1787853062.774817:0:11173:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787853062.774863:0:11173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f492a8ac000/0x710df789068e625c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853062.774890:0:11173:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f492a8ad000/0x710df789068e6201 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389585 expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853062.774903:0:11173:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f4921e20a00/0x710df789068e620f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x710df789068e6208 expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853062.774912:0:11173:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f4921e20c00/0x710df789068e621d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x710df789068e6216 expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853062.774946:0:11173:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f49415b8200/0x710df789068e622b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x710df789068e6224 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853062.774955:0:11173:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f4900030400/0x710df789068e6240 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793895bd expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853062.774964:0:11173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f492a8ac000/0x710df789068e625c lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853062.775020:0:11173:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f4900030400/0x710df789068e6240 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793895bd expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853062.775037:0:11173:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f4900030400/0x710df789068e6240 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793895bd expref: 12 pid: 5829 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853062.777644:0:11173:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f493fd55a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11173:1874699552347520:192.168.204.1@tcp:104: 00010000:00010000:1.0:1787853062.777878:0:11173:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f49415b8200/0x710df789068e622b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x710df789068e6224 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853062.777898:0:11173:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f49415b8200/0x710df789068e622b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x710df789068e6224 expref: 18 pid: 5831 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853062.777920:0:11173:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f493fd543c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11173:1874699552347648:0@lo:104: 00000100:00100000:1.0:1787853062.777981:0:11173:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787853062.778043:0:11173:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f4921e20c00/0x710df789068e621d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x710df789068e6216 expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853062.778051:0:11173:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f4921e20c00/0x710df789068e621d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x710df789068e6216 expref: 18 pid: 5829 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853062.778099:0:11173:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f493fd56940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11173:1874699552347776:0@lo:104: 00000100:00100000:1.0:1787853062.778125:0:11173:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787853062.778169:0:11173:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f4921e20a00/0x710df789068e620f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x710df789068e6208 expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853062.778178:0:11173:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f4921e20a00/0x710df789068e620f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x710df789068e6208 expref: 18 pid: 5829 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853062.778186:0:11173:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f493fd54000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11173:1874699552347904:0@lo:104: 00000100:00100000:1.0:1787853062.778207:0:11173:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787853062.778234:0:11173:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f492a8ad000/0x710df789068e6201 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389585 expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853062.778242:0:11173:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f492a8ad000/0x710df789068e6201 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389585 expref: 12 pid: 5829 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853062.778253:0:11173:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f494159da40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11173:1874699552348032:192.168.204.1@tcp:104: 00000100:00100000:1.0:1787853062.778280:0:11173:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f493c5a0480 going to sleep for 11 seconds 00000100:00100000:3.0:1787853062.778398:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552347648 00000100:00100000:3.0:1787853062.778408:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552347648 00000100:00100000:3.0:1787853062.778474:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552347776 00000100:00100000:3.0:1787853062.778478:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552347776 00000100:00100000:3.0:1787853062.778489:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552347904 00000100:00100000:3.0:1787853062.778498:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552347904 00000100:00100000:3.0:1787853062.778514:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787853062.778522:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493fd54b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5d48a955-7010-4118-9c7d-f396984ae1ff+5:11173:x1874699552347648:12345-0@lo:104: 00010000:00010000:3.0:1787853062.778537:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.101@tcp lock: ffff8f49415b9e00/0x710df789068e6224 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x710df789068e622b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853062.778633:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787853062.778639:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493fd54b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5d48a955-7010-4118-9c7d-f396984ae1ff+5:11173:x1874699552347648:12345-0@lo:104: Request processed in 118us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853062.778648:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787853062.778668:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787853062.778674:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493fd570c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5d48a955-7010-4118-9c7d-f396984ae1ff+4:11173:x1874699552347776:12345-0@lo:104: 00010000:00010000:3.0:1787853062.778681:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.101@tcp lock: ffff8f4921e21c00/0x710df789068e6216 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x710df789068e621d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853062.778711:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787853062.778715:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493fd570c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5d48a955-7010-4118-9c7d-f396984ae1ff+4:11173:x1874699552347776:12345-0@lo:104: Request processed in 42us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853062.778721:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787853062.778730:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787853062.778736:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49031c2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5d48a955-7010-4118-9c7d-f396984ae1ff+3:11173:x1874699552347904:12345-0@lo:104: 00010000:00010000:3.0:1787853062.778743:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.101@tcp lock: ffff8f49415b8000/0x710df789068e6208 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x710df789068e620f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853062.778779:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1787853062.778786:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49031c2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5d48a955-7010-4118-9c7d-f396984ae1ff+3:11173:x1874699552347904:12345-0@lo:104: Request processed in 49us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853062.778795:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:3.0:1787853062.778827:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787853062.778835:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.101@tcp lock: ffff8f49415b9e00/0x710df789068e6224 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x710df789068e622b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853062.778844:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b9e00 already unused, calling callback (ffffffffc1b55c20) 10000000:00010000:3.0:1787853062.778850:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.101@tcp lock: ffff8f49415b9e00/0x710df789068e6224 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x710df789068e622b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853062.778862:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.101@tcp lock: ffff8f49415b9e00/0x710df789068e6224 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x710df789068e622b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853062.778862:0:8449:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 10000000:00010000:3.0:1787853062.778884:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.101@tcp lock: ffff8f49415b9e00/0x710df789068e6224 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x710df789068e622b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853062.778886:0:8449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.101@tcp lock: ffff8f4921e21c00/0x710df789068e6216 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x710df789068e621d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787853062.778911:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787853062.778919:0:8449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4921e21c00 already unused, calling callback (ffffffffc1b55c20) 10000000:00010000:2.0:1787853062.778927:0:8449:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.101@tcp lock: ffff8f4921e21c00/0x710df789068e6216 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x710df789068e621d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853062.778939:0:8449:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.101@tcp lock: ffff8f4921e21c00/0x710df789068e6216 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x710df789068e621d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787853062.778948:0:8449:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.101@tcp lock: ffff8f4921e21c00/0x710df789068e6216 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x710df789068e621d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853062.778953:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.101@tcp lock: ffff8f49415b9e00/0x710df789068e6224 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x710df789068e622b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787853062.778954:0:8449:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787853062.778973:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787853062.779005:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.101@tcp lock: ffff8f49415b9e00/0x710df789068e6224 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x710df789068e622b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853062.779014:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.101@tcp lock: ffff8f49415b9e00/0x710df789068e6224 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x710df789068e622b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853062.779024:0:8449:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.101@tcp lock: ffff8f4921e21c00/0x710df789068e6216 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x710df789068e621d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853062.779033:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787853062.779034:0:8449:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787853062.779039:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.101@tcp lock: ffff8f49415b8000/0x710df789068e6208 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x710df789068e620f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853062.779052:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b8000 already unused, calling callback (ffffffffc1b55c20) 10000000:00010000:3.0:1787853062.779055:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.101@tcp lock: ffff8f49415b8000/0x710df789068e6208 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x710df789068e620f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853062.779076:0:8449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.101@tcp lock: ffff8f4921e21c00/0x710df789068e6216 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x710df789068e621d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853062.779093:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.101@tcp lock: ffff8f49415b8000/0x710df789068e6208 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x710df789068e620f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853062.779095:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.101@tcp lock: ffff8f4921e21c00/0x710df789068e6216 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x710df789068e621d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787853062.779131:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.101@tcp lock: ffff8f49415b8000/0x710df789068e6208 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x710df789068e620f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787853062.779139:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787853062.779173:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.101@tcp lock: ffff8f49415b8000/0x710df789068e6208 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x710df789068e620f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853062.779174:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853062.779178:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853062.779181:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787853062.779189:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1787853062.779196:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:3.0:1787853062.779202:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.101@tcp lock: ffff8f49415b8000/0x710df789068e6208 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x710df789068e620f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853062.779212:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.101@tcp lock: ffff8f49415b8000/0x710df789068e6208 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x710df789068e620f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853062.779226:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49065d5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5d48a955-7010-4118-9c7d-f396984ae1ff:3308:1874699552348160:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787853062.779234:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787853062.779238:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787853062.779240:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787853062.779252:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787853062.779302:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853062.779376:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f493c5a6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5d48a955-7010-4118-9c7d-f396984ae1ff:3306:1874699552348288:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787853062.779404:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853062.779428:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787853062.779434:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49065d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5d48a955-7010-4118-9c7d-f396984ae1ff:3306:1874699552348416:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787853062.779456:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853062.779492:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552348160 00000100:00100000:2.0:1787853062.779501:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552348160 00010000:00010000:2.0:1787853062.779531:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f49415b8200/0x710df789068e622b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x710df789068e6224 expref: 19 pid: 5831 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853062.779558:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552348288 00000100:00100000:2.0:1787853062.779561:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552348288 00010000:00010000:2.0:1787853062.779596:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f4921e20c00/0x710df789068e621d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x710df789068e6216 expref: 20 pid: 5829 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853062.779610:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552348416 00000100:00100000:2.0:1787853062.779614:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552348416 00010000:00010000:2.0:1787853062.779629:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f4921e20a00/0x710df789068e620f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x710df789068e6208 expref: 21 pid: 5829 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853062.779649:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787853062.779664:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787853062.779666:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493c5a7c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5d48a955-7010-4118-9c7d-f396984ae1ff+21:3308:x1874699552348160:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787853062.779683:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f491e972c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5d48a955-7010-4118-9c7d-f396984ae1ff+21:3306:x1874699552348288:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787853062.779703:0:8450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787853062.779710:0:8450:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f4921e20c00/0x710df789068e621d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x710df789068e6216 expref: 21 pid: 5829 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853062.779711:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787853062.779727:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f49415b8200/0x710df789068e622b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x710df789068e6224 expref: 21 pid: 5831 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853062.779732:0:8450:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f4921e20c00/0x710df789068e621d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x710df789068e6216 expref: 21 pid: 5829 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853062.779971:0:5822:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:0.0:1787853062.779981:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00000100:00100000:0.0:1787853062.780173:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787853062.780183:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493c5a4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d48a955-7010-4118-9c7d-f396984ae1ff+21:3306:x1874699552348416:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787853062.780193:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787853062.780205:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f4921e20a00/0x710df789068e620f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x710df789068e6208 expref: 21 pid: 5829 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853062.780303:0:11173:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f493fd543c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11173:1874699552347648:0@lo:104: 00000100:00100000:1.0:1787853062.780314:0:11173:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f493fd56940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11173:1874699552347776:0@lo:104: 00000100:00100000:1.0:1787853062.780322:0:11173:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f493fd54000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11173:1874699552347904:0@lo:104: 00010000:00010000:2.0:1787853062.785602:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f49415b8200/0x710df789068e622b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x710df789068e6224 expref: 21 pid: 5831 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853062.785637:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f49415b8200/0x710df789068e622b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x710df789068e6224 expref: 21 pid: 5831 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853062.785659:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787853062.785777:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f4921e20a00/0x710df789068e620f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x710df789068e6208 expref: 20 pid: 5829 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853062.785787:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493c5a7c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5d48a955-7010-4118-9c7d-f396984ae1ff+20:3308:x1874699552348160:12345-0@lo:103:ldlm_bl.0 Request processed in 6125us (6481us total) trans 0 rc 0/0 00010000:00010000:0.0:1787853062.785815:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f4921e20a00/0x710df789068e620f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x710df789068e6208 expref: 20 pid: 5829 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853062.785832:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787853062.785949:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853062.786300:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49065d5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5d48a955-7010-4118-9c7d-f396984ae1ff:3308:1874699552348160:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787853062.786355:0:11173:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f493fd55a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11173:1874699552347520:192.168.204.1@tcp:104: 00000100:00100000:1.0:1787853062.786364:0:11173:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f494159da40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11173:1874699552348032:192.168.204.1@tcp:104: 00010000:00010000:1.0:1787853062.786404:0:11173:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f492a8ac000/0x710df789068e625c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853062.786537:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853062.786561:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787853062.786626:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493c5a4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d48a955-7010-4118-9c7d-f396984ae1ff+19:3306:x1874699552348416:12345-0@lo:103:ldlm_bl.0 Request processed in 6443us (7166us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853062.786694:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49065d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5d48a955-7010-4118-9c7d-f396984ae1ff:3306:1874699552348416:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787853062.786863:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f4921e20c00/0x710df789068e621d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x710df789068e6216 expref: 19 pid: 5829 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853062.786879:0:8450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787853062.786960:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f491e972c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5d48a955-7010-4118-9c7d-f396984ae1ff+18:3306:x1874699552348288:12345-0@lo:103:ldlm_bl.0 Request processed in 7286us (7554us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853062.786998:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f493c5a6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5d48a955-7010-4118-9c7d-f396984ae1ff:3306:1874699552348288:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787853062.787058:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787853062.787106:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526094208 00000100:00100000:0.0:1787853062.787115:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526094208 00010000:00010000:0.0:1787853062.787153:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f4900030400/0x710df789068e6240 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793895bd expref: 13 pid: 5829 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853062.787174:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526094336 00000100:00100000:0.0:1787853062.787177:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526094336 00010000:00010000:0.0:1787853062.787189:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f492a8ad000/0x710df789068e6201 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389585 expref: 14 pid: 5829 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853062.787203:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 28 00000100:00100000:0.0:1787853062.787213:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4921694f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af755b38-4932-400a-92cc-ddad0ca077a5+14:2362:x1874699526094208:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787853062.787230:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787853062.787236:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f4900030400/0x710df789068e6240 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793895bd expref: 14 pid: 5829 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853062.787265:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f4900030400/0x710df789068e6240 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793895bd expref: 14 pid: 5829 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853062.787279:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f4900030400/0x710df789068e6240 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793895bd expref: 14 pid: 5829 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853062.787289:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787853062.787353:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4921694f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af755b38-4932-400a-92cc-ddad0ca077a5+13:2362:x1874699526094208:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 141us (1407us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853062.787361:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 28 00000100:00100000:0.0:1787853062.787376:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 29 00000100:00100000:0.0:1787853062.787383:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4904cd7840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af755b38-4932-400a-92cc-ddad0ca077a5+12:2362:x1874699526094336:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787853062.787392:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787853062.787396:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f492a8ad000/0x710df789068e6201 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389585 expref: 12 pid: 5829 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853062.787405:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f492a8ad000/0x710df789068e6201 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389585 expref: 12 pid: 5829 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853062.787415:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f492a8ad000/0x710df789068e6201 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389585 expref: 12 pid: 5829 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853062.787427:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f492a8ac000/0x710df789068e625c lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853062.787442:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f492a8ac000/0x710df789068e625c lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853062.787472:0:5822:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f492a8ac000/0x710df789068e625c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853062.787479:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f492a8ac000/0x710df789068e625c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853062.787486:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f492a8ac000/0x710df789068e625c lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853062.787493:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f492a8ac000/0x710df789068e625c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853062.787499:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f492a8ac000 already unused, calling callback (ffffffffc1528440) 00010000:00010000:0.0:1787853062.787504:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f492a8ac000/0x710df789068e625c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853062.787514:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f492a8ac000/0x710df789068e625c lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853062.787527:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f492a8ac000/0x710df789068e625c lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853062.787538:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787853062.787597:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4904cd7840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af755b38-4932-400a-92cc-ddad0ca077a5+11:2362:x1874699526094336:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 213us (1060us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853062.787604:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 29 00010000:00010000:1.0:1787853062.788696:0:11173:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f492a8ac000/0x710df789068e625c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853062.788714:0:11173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f492a8ac000/0x710df789068e625c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853062.788721:0:11173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f492a8ac000/0x710df789068e625c lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853062.792850:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:2.0:1787853062.958144:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787853063.977981:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787853064.362330:0:5834:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787853064.362338:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f493dc01800 from 7 10000000:01000000:1.0:1787853064.362343:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787853064.362395:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f492a8ac000/0x710df789068e6263 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853064.362408:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.101@tcp lock: ffff8f492a8ac000/0x710df789068e6263 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853064.362421:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: ffff8f492a8ac000/0x710df789068e6263 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853064.362452:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f494159da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552348544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787853064.362530:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853064.362617:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f493c5a0180 going to sleep for 11 seconds 00000100:00100000:0.0:1787853064.362680:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552348544 00000100:00100000:0.0:1787853064.362687:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552348544 00000100:00100000:0.0:1787853064.362746:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1787853064.362757:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4906233450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d48a955-7010-4118-9c7d-f396984ae1ff+16:5834:x1874699552348544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787853064.362783:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853064.362797:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f4900030400/0x710df789068e626a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x710df789068e6263 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853064.362820:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f4900030400/0x710df789068e626a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x710df789068e6263 expref: 17 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853064.362830:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f4900030400/0x710df789068e626a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x710df789068e6263 expref: 17 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853064.362840:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4900030400, rc 0) 00000100:00100000:0.0:1787853064.362886:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4906233450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d48a955-7010-4118-9c7d-f396984ae1ff+17:5834:x1874699552348544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853064.362893:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1787853064.362989:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f494159da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552348544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787853064.363006:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: ffff8f492a8ac000/0x710df789068e6263 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e626a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853064.363015:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: ffff8f492a8ac000/0x710df789068e6263 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x710df789068e626a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853064.363096:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f493c5a52c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552348672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787853064.363127:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853064.363161:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f4910dbbe40 going to sleep for 11 seconds 00000100:00100000:0.0:1787853064.363362:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552348672 00000100:00100000:0.0:1787853064.363367:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552348672 00000100:00100000:0.0:1787853064.363392:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1787853064.363398:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4906232450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+17:5834:x1874699552348672:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787853064.363711:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4906232450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+17:5834:x1874699552348672:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 312us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853064.363719:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1787853064.363757:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f493c5a52c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552348672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787853064.363791:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f493bee8b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552348800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787853064.363832:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853064.363853:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f492064e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787853064.363865:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552348800 00000100:00100000:0.0:1787853064.363868:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552348800 00000100:00100000:0.0:1787853064.363900:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1787853064.363907:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4906230050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+17:5834:x1874699552348800:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787853064.364072:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4906230050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+17:5834:x1874699552348800:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 165us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853064.364079:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1787853064.364722:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f493bee8b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552348800:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787853064.382847:0:11203:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1787853064.383071:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1787853064.383108:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787853064.383123:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f492a8ac000/0x710df789068e6263 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e626a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853064.383136:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: ffff8f492a8ac000/0x710df789068e6263 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e626a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787853064.383147:0:5834:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787853064.383150:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f4903010800 from 7 10000000:01000000:0.0:1787853064.383153:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787853064.383197:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f4900030200/0x710df789068e6271 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853064.383205:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.101@tcp lock: ffff8f4900030200/0x710df789068e6271 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853064.383219:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: ffff8f4900030200/0x710df789068e6271 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853064.383253:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f493bee8b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552348928:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787853064.383328:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853064.383391:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f492064e9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787853064.383608:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552348928 00000100:00100000:1.0:1787853064.383623:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552348928 00000100:00100000:1.0:1787853064.383785:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1787853064.383795:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4906230c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+17:5834:x1874699552348928:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787853064.383810:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853064.383824:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f492a8ac800/0x710df789068e6278 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x710df789068e6271 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853064.383849:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f492a8ac800/0x710df789068e6278 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x710df789068e6271 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853064.383859:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f492a8ac800/0x710df789068e6278 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x710df789068e6271 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853064.383868:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f492a8ac800, rc 0) 00000100:00100000:1.0:1787853064.383916:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4906230c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+18:5834:x1874699552348928:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853064.383923:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1787853064.384215:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f493bee8b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552348928:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787853064.384230:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: ffff8f4900030200/0x710df789068e6271 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e6278 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853064.384239:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: ffff8f4900030200/0x710df789068e6271 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x710df789068e6278 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853064.384290:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f493bee8b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552349056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787853064.384318:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853064.384347:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f492064e9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787853064.385537:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552349056 00000100:00100000:1.0:1787853064.385549:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552349056 00000100:00100000:1.0:1787853064.385612:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1787853064.385621:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4906233050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+18:5834:x1874699552349056:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787853064.385954:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4906233050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+18:5834:x1874699552349056:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 333us (1634us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853064.385963:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1787853064.386599:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f493bee8b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552349056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787853064.386664:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f493bee8b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552349184:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787853064.386719:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853064.386755:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f492064e9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787853064.387818:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552349184 00000100:00100000:1.0:1787853064.387828:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552349184 00000100:00100000:1.0:1787853064.387881:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1787853064.387891:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4906231850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d48a955-7010-4118-9c7d-f396984ae1ff+18:5834:x1874699552349184:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787853064.388277:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4906231850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d48a955-7010-4118-9c7d-f396984ae1ff+18:5834:x1874699552349184:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 387us (1558us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853064.388285:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1787853064.388561:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f493bee8b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552349184:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787853064.390516:0:11205:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1787853064.390865:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1787853064.390888:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787853064.390899:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f4900030200/0x710df789068e6271 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e6278 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853064.390910:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: ffff8f4900030200/0x710df789068e6271 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e6278 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787853064.390921:0:5834:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787853064.390923:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f492abd6000 from 7 10000000:01000000:0.0:1787853064.390926:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787853064.390973:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f4900031a00/0x710df789068e627f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853064.390982:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.101@tcp lock: ffff8f4900031a00/0x710df789068e627f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853064.390993:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: ffff8f4900031a00/0x710df789068e627f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853064.391020:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f493bee8b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552349312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787853064.391110:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853064.391149:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f492064e9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787853064.391290:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552349312 00000100:00100000:2.0:1787853064.391300:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552349312 00000100:00100000:2.0:1787853064.391346:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1787853064.391354:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4906230450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+18:5834:x1874699552349312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787853064.391376:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853064.391388:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f49415b9200/0x710df789068e6286 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x710df789068e627f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853064.391410:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f49415b9200/0x710df789068e6286 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x710df789068e627f expref: 19 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853064.391420:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f49415b9200/0x710df789068e6286 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x710df789068e627f expref: 19 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853064.391429:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49415b9200, rc 0) 00000100:00100000:2.0:1787853064.391479:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4906230450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+19:5834:x1874699552349312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853064.391486:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1787853064.394850:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f493bee8b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552349312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787853064.394882:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: ffff8f4900031a00/0x710df789068e627f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e6286 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853064.394895:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: ffff8f4900031a00/0x710df789068e627f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x710df789068e6286 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853064.394980:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f493bee8b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552349440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787853064.395062:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853064.395209:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f492064e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787853064.399969:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853064.405925:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552349440 00000100:00100000:2.0:1787853064.405942:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552349440 00000100:00100000:1.0:1787853064.408233:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526094464 00000100:00100000:1.0:1787853064.408245:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526094464 00000100:00100000:1.0:1787853064.408742:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 245 00000100:00100000:1.0:1787853064.408752:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f490621c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af755b38-4932-400a-92cc-ddad0ca077a5+11:5609:x1874699526094464:12345-192.168.204.1@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787853064.408771:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853064.408790:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f492a8ac600/0x710df789068e628d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd0a9c50793895e7 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853064.408821:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f492a8ac600/0x710df789068e628d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793895e7 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853064.408832:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f492a8ac600/0x710df789068e628d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793895e7 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853064.408842:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f492a8ac600, rc 0) 00000100:00100000:1.0:1787853064.408911:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f490621c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af755b38-4932-400a-92cc-ddad0ca077a5+12:5609:x1874699526094464:12345-192.168.204.1@tcp:101:ll_cfg_requeue.0 Request processed in 160us (8956us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853064.408918:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 245 00000100:00100000:3.0:1787853064.414789:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853064.414828:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526094592 00000100:00100000:3.0:1787853064.414839:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526094592 00000100:00100000:3.0:1787853064.414890:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 246 00000100:00100000:3.0:1787853064.414899:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f490621c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af755b38-4932-400a-92cc-ddad0ca077a5+12:5609:x1874699526094592:12345-192.168.204.1@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787853064.415215:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f490621c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af755b38-4932-400a-92cc-ddad0ca077a5+12:5609:x1874699526094592:12345-192.168.204.1@tcp:501:ll_cfg_requeue.0 Request processed in 316us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853064.415223:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 246 00000100:00100000:3.0:1787853064.415366:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1787853064.415373:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4906233850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d48a955-7010-4118-9c7d-f396984ae1ff+19:5834:x1874699552349440:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787853064.415553:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4906233850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d48a955-7010-4118-9c7d-f396984ae1ff+19:5834:x1874699552349440:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 180us (20491us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853064.415560:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1787853064.415627:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f493bee8b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552349440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787853064.415685:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49065d61c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552349568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787853064.415730:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853064.415765:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f49101b8900 going to sleep for 11 seconds 00000100:00100000:3.0:1787853064.415779:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552349568 00000100:00100000:3.0:1787853064.415784:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552349568 00000100:00100000:3.0:1787853064.415806:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1787853064.415813:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f490621e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+19:5834:x1874699552349568:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787853064.415962:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f490621e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+19:5834:x1874699552349568:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 149us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853064.415969:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1787853064.416010:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49065d61c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552349568:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787853064.423408:0:11207:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1787853064.429809:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1787853064.429851:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787853064.429863:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f4900031a00/0x710df789068e627f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e6286 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853064.429876:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: ffff8f4900031a00/0x710df789068e627f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e6286 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853064.433532:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853064.434111:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526094720 00000100:00100000:3.0:1787853064.434122:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526094720 00000100:00100000:3.0:1787853064.434176:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 249 00000100:00100000:3.0:1787853064.434186:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f490621f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af755b38-4932-400a-92cc-ddad0ca077a5+12:5609:x1874699526094720:12345-192.168.204.1@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787853064.434485:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f490621f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af755b38-4932-400a-92cc-ddad0ca077a5+12:5609:x1874699526094720:12345-192.168.204.1@tcp:503:ll_cfg_requeue.0 Request processed in 299us (962us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853064.434493:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 249 00000100:00100000:3.0:1787853064.445448:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853064.445963:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526094848 00000100:00100000:1.0:1787853064.445973:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526094848 00000100:00100000:1.0:1787853064.446050:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 250 00000100:00100000:1.0:1787853064.446060:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f490621f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af755b38-4932-400a-92cc-ddad0ca077a5+12:5609:x1874699526094848:12345-192.168.204.1@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787853064.446078:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853064.446117:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f492a8ace00/0x710df789068e6294 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd0a9c50793895ee expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853064.446146:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f492a8ace00/0x710df789068e6294 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793895ee expref: 13 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853064.446158:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f492a8ace00/0x710df789068e6294 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793895ee expref: 13 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853064.446167:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f492a8ace00, rc 0) 00000100:00100000:1.0:1787853064.446222:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f490621f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af755b38-4932-400a-92cc-ddad0ca077a5+13:5609:x1874699526094848:12345-192.168.204.1@tcp:101:ll_cfg_requeue.0 Request processed in 163us (786us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853064.446230:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 250 00000100:00100000:3.0:1787853064.459257:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853064.459735:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526094976 00000100:00100000:0.0:1787853064.459746:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526094976 00000100:00100000:0.0:1787853064.459804:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 251 00000100:00100000:0.0:1787853064.459815:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f490621d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af755b38-4932-400a-92cc-ddad0ca077a5+13:5609:x1874699526094976:12345-192.168.204.1@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787853064.460160:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f490621d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af755b38-4932-400a-92cc-ddad0ca077a5+13:5609:x1874699526094976:12345-192.168.204.1@tcp:501:ll_cfg_requeue.0 Request processed in 345us (911us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853064.460169:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 251 00000100:00100000:0.0:1787853064.474160:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853064.474287:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526095104 00000100:00100000:1.0:1787853064.474299:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526095104 00000100:00100000:1.0:1787853064.474363:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 252 00000100:00100000:1.0:1787853064.474374:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f490621fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af755b38-4932-400a-92cc-ddad0ca077a5+13:5609:x1874699526095104:12345-192.168.204.1@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787853064.474675:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f490621fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af755b38-4932-400a-92cc-ddad0ca077a5+13:5609:x1874699526095104:12345-192.168.204.1@tcp:503:ll_cfg_requeue.0 Request processed in 302us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853064.474684:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 252 00000100:00100000:0.0:1787853064.937871:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787853064.937947:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787853064.937971:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f494159cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874699552349824:0@lo:400:kworker.0 00000100:00100000:3.0:1787853064.938053:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853064.938126:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552349824 00000100:00100000:3.0:1787853064.938134:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552349824 00000100:00100000:3.0:1787853064.938183:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787853064.938192:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49065d61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874699552349824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853064.938257:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49065d61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874699552349824:12345-0@lo:400:kworker.0 Request processed in 66us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853064.938265:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787853064.938309:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f494159cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874699552349824:0@lo:400:kworker.0 00000100:00100000:0.0:1787853064.939158:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f494159d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5d48a955-7010-4118-9c7d-f396984ae1ff:3309:1874699552349696:0@lo:400:kworker.0 00000100:00100000:0.0:1787853064.939213:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853064.939539:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f494159c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552349952:0@lo:400:kworker.0 00000100:00100000:1.0:1787853064.939591:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853064.939614:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787853064.939619:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f494159ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1874699552350080:0@lo:400:kworker.0 00000100:00100000:1.0:1787853064.939643:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853064.939676:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552350080 00000100:00100000:1.0:1787853064.939682:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552350080 00000100:00100000:1.0:1787853064.939747:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787853064.939764:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f494159e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874699552350080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853064.939812:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f494159e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874699552350080:12345-0@lo:400:kworker.0 Request processed in 50us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853064.939819:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:1.0:1787853064.939841:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787853064.939869:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f494159ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1874699552350080:0@lo:400:kworker.0 00000100:00100000:1.0:1787853064.939893:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f494159cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874699552350336:0@lo:400:kworker.0 00000100:00100000:0.0:1787853064.940061:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552349952 00000100:00100000:0.0:1787853064.940065:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552349952 00000100:00100000:0.0:1787853064.940105:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787853064.940112:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f494159da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1874699552349952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853064.940152:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f494159da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1874699552349952:12345-0@lo:400:kworker.0 Request processed in 41us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853064.940158:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787853064.940180:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f494159f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1874699552350208:0@lo:400:kworker.0 00000100:00100000:0.0:1787853064.940205:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787853064.940244:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787853064.940266:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f494159c3c0 x1874699552349952/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787853080 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787853064.940277:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f494159c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552349952:0@lo:400:kworker.0 00000100:00100000:0.0:1787853064.940301:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552350208 00000100:00100000:0.0:1787853064.940304:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552350208 00000100:00100000:0.0:1787853064.940333:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787853064.940340:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493bee9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874699552350208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853064.940385:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493bee9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874699552350208:12345-0@lo:400:kworker.0 Request processed in 45us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853064.940398:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00080000:0.0:1787853064.940413:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787853064.940429:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f494159f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1874699552350208:0@lo:400:kworker.0 00000100:00100000:1.0:1787853064.940683:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853064.942087:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552350336 00000100:00100000:0.0:1787853064.942099:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552350336 00000100:00100000:0.0:1787853064.942169:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787853064.942179:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f494159ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1874699552350336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853064.942253:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f494159ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1874699552350336:12345-0@lo:400:kworker.0 Request processed in 76us (1570us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853064.942260:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:1.0:1787853064.942339:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787853064.942443:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f494159cb40 x1874699552350336/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787853080 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787853064.942458:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f494159cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874699552350336:0@lo:400:kworker.0 00000100:00100000:3.0:1787853064.942541:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552349696 00000100:00100000:3.0:1787853064.942546:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552349696 00000100:00100000:3.0:1787853064.943716:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1787853064.943732:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f490621d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+19:3309:x1874699552349696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853064.943813:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f490621d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+19:3309:x1874699552349696:12345-0@lo:400:kworker.0 Request processed in 87us (4600us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853064.943820:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1787853064.943910:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f494159d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5d48a955-7010-4118-9c7d-f396984ae1ff:3309:1874699552349696:0@lo:400:kworker.0 00010000:00010000:3.0:1787853065.002113:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787853065.449976:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f494159cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552350464:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787853065.450203:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853065.450339:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787853065.450346:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f494159d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552350592:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787853065.450372:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853065.465311:0:10348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552350464 00000100:00100000:1.0:1787853065.465511:0:10348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552350464 00000100:00100000:1.0:1787853065.465745:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552350592 00000100:00100000:1.0:1787853065.465750:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552350592 00000100:00100000:1.0:1787853065.465870:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787853065.465881:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493c5a5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874699552350592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787853065.465922:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787853065.466023:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493c5a5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874699552350592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 132us (15637us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853065.466031:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:3.0:1787853065.466120:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f494159d680 x1874699552350592/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787853081 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787853065.466143:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f494159d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552350592:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787853065.466297:0:10348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787853065.466305:0:10348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493c5a4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874699552350464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787853065.466557:0:10348:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787853065.466808:0:10348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493c5a4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874699552350464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 503us (16605us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853065.466816:0:10348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:3.0:1787853065.466890:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f494159cb40 x1874699552350464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787853081 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787853065.466908:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f494159cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552350464:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787853066.025742:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787853066.926965:0:11372:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg401-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787853067.050205:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787853067.584783:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853067.584850:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853067.584885:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853067.584980:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526095488 00000100:00100000:1.0:1787853067.584991:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526095488 00000100:00100000:1.0:1787853067.585088:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526095360 00000100:00100000:1.0:1787853067.585092:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526095360 00000100:00100000:2.0:1787853067.585108:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 110 00000100:00100000:2.0:1787853067.585123:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493beeb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ea3b4e1-e827-460f-be07-19e86dff3d79+5:2365:x1874699526095488:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:3.0:1787853067.585160:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526095232 00000100:00100000:3.0:1787853067.585166:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526095232 00000100:00100000:2.0:1787853067.585213:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493beeb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ea3b4e1-e827-460f-be07-19e86dff3d79+5:2365:x1874699526095488:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 93us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853067.585214:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 254 00000100:00100000:3.0:1787853067.585227:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f490621e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af755b38-4932-400a-92cc-ddad0ca077a5+13:2365:x1874699526095232:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:3.0:1787853067.585268:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f490621e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af755b38-4932-400a-92cc-ddad0ca077a5+13:2365:x1874699526095232:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 45us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853067.585291:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 254 00000100:00080000:0.0:1787853067.585353:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787853067.585925:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 111 00000100:00100000:1.0:1787853067.585938:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493bee8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+6:2365:x1874699526095360:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:1.0:1787853067.586003:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493bee8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+6:2365:x1874699526095360:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 70us (1117us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853067.586144:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 111 00000100:00100000:2.0:1787853067.586638:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 110 00010000:00010000:3.0:1787853068.074899:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853069.100310:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787853070.058033:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f493c5a7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1874699552351104:0@lo:400:kworker.0 00000100:00100000:2.0:1787853070.058115:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853070.058188:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787853070.058194:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f493c5a61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874699552350976:0@lo:400:kworker.0 00000100:00100000:2.0:1787853070.058222:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853070.058374:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f493c5a4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874699552350848:0@lo:400:kworker.0 00000100:00100000:1.0:1787853070.058404:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853070.058428:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f493c5a70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874699552351360:0@lo:400:kworker.0 00000100:00100000:1.0:1787853070.058449:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853070.058472:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787853070.058478:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f493c5a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5d48a955-7010-4118-9c7d-f396984ae1ff:3309:1874699552350720:0@lo:400:kworker.0 00000100:00100000:1.0:1787853070.058505:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853070.058524:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f493c5a43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1874699552351232:0@lo:400:kworker.0 00000100:00100000:1.0:1787853070.058544:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853070.058662:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552351104 00000100:00100000:3.0:1787853070.058670:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552351104 00000100:00100000:3.0:1787853070.058735:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552350848 00000100:00100000:3.0:1787853070.058738:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552350848 00000100:00100000:3.0:1787853070.058751:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552351232 00000100:00100000:3.0:1787853070.058753:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552351232 00000100:00100000:3.0:1787853070.058773:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787853070.058782:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493c5a5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874699552351104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853070.058835:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493c5a5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874699552351104:12345-0@lo:400:kworker.0 Request processed in 55us (720us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853070.058843:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787853070.058873:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787853070.058880:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f494159c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874699552350848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853070.058914:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f494159c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874699552350848:12345-0@lo:400:kworker.0 Request processed in 34us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853070.058919:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787853070.058943:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1787853070.058950:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f494159cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874699552351232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853070.058978:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f494159cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874699552351232:12345-0@lo:400:kworker.0 Request processed in 29us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853070.058983:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1787853070.059000:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552350720 00000100:00100000:3.0:1787853070.059003:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552350720 00000100:00100000:3.0:1787853070.059027:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1787853070.059033:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f490621ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+19:3309:x1874699552350720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853070.059239:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552350976 00000100:00100000:0.0:1787853070.059244:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552350976 00000100:00100000:0.0:1787853070.059276:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552351360 00000100:00100000:0.0:1787853070.059279:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552351360 00000100:00100000:0.0:1787853070.059299:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787853070.059306:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493c5a6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1874699552350976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853070.059476:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493c5a6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1874699552350976:12345-0@lo:400:kworker.0 Request processed in 45us (1127us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853070.059484:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787853070.059508:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787853070.059514:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f494159f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1874699552351360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853070.059546:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f494159f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1874699552351360:12345-0@lo:400:kworker.0 Request processed in 33us (1096us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853070.059553:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:2.0:1787853070.059625:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f493c5a61c0 x1874699552350976/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787853086 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787853070.059645:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f493c5a43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1874699552351232:0@lo:400:kworker.0 00000100:00100000:2.0:1787853070.059646:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f493c5a61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874699552350976:0@lo:400:kworker.0 00000100:00100000:0.0:1787853070.059657:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f493c5a4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874699552350848:0@lo:400:kworker.0 00000100:00100000:2.0:1787853070.059660:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f493c5a7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1874699552351104:0@lo:400:kworker.0 00010000:00080000:0.0:1787853070.059667:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f493c5a70c0 x1874699552351360/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787853086 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787853070.059675:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f493c5a70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874699552351360:0@lo:400:kworker.0 00000100:00100000:3.0:1787853070.059760:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f490621ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+19:3309:x1874699552350720:12345-0@lo:400:kworker.0 Request processed in 726us (1254us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853070.059767:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00080000:1.0:1787853070.060022:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787853070.060027:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787853070.060030:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787853070.060228:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f493c5a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5d48a955-7010-4118-9c7d-f396984ae1ff:3309:1874699552350720:0@lo:400:kworker.0 00010000:00010000:3.0:1787853070.121727:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787853070.579198:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787853070.579221:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4941742940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874699552351488:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787853070.579288:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853070.579365:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552351488 00000100:00100000:0.0:1787853070.579372:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552351488 00000100:00100000:0.0:1787853070.579426:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787853070.579437:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4941740780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874699552351488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787853070.579480:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787853070.579535:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4941740780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874699552351488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853070.579543:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:0.0:1787853070.579620:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f4941742940 x1874699552351488/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787853086 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787853070.579645:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4941742940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874699552351488:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787853070.579677:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f493fd552c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874699552351616:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787853070.579704:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853070.579770:0:10348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552351616 00000100:00100000:3.0:1787853070.579775:0:10348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552351616 00000100:00100000:3.0:1787853070.579868:0:10348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787853070.579877:0:10348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4941742940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874699552351616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787853070.579900:0:10348:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787853070.579967:0:10348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4941742940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874699552351616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853070.579975:0:10348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:1.0:1787853070.580227:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f493fd552c0 x1874699552351616/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787853086 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787853070.580241:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f493fd552c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874699552351616:0@lo:13:osp-pre-1-0.0 00000001:02000400:3.0:1787853070.884336:0:11471:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 13:51:09 (1787853069) === 00010000:00010000:1.0:1787853071.149085:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787853071.184403:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853071.184477:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853071.184503:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526095616 00000100:00100000:3.0:1787853071.184611:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526095616 00000100:00100000:3.0:1787853071.184793:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 14 00000100:00100000:3.0:1787853071.184807:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4941741a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+6:2363:x1874699526095616:12345-192.168.204.1@tcp:41:mkdir.0 00000004:00000024:3.0:1787853071.184856:0:5837:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787853071.184977:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4941741a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+6:2363:x1874699526095616:12345-192.168.204.1@tcp:41:mkdir.0 Request processed in 174us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853071.184985:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 14 00000100:00080000:0.0:1787853071.185329:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787853071.194673:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526095744 00000100:00100000:0.0:1787853071.194689:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526095744 00000100:00100000:0.0:1787853071.194798:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 0 00000100:00100000:0.0:1787853071.194809:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49079f03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:b1d98f5a-0be0-4f69-83a6-833c935c8205+6:9709:x1874699526095744:12345-192.168.204.1@tcp:700:mkdir.0 00000100:00100000:0.0:1787853071.194939:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49079f03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:b1d98f5a-0be0-4f69-83a6-833c935c8205+6:9709:x1874699526095744:12345-192.168.204.1@tcp:700:mkdir.0 Request processed in 132us (10462us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853071.194948:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 0 00000100:00100000:0.0:1787853071.207801:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853071.208058:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526096000 00000100:00100000:2.0:1787853071.208076:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526096000 00000100:00100000:2.0:1787853071.208183:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 15 00000100:00100000:2.0:1787853071.208196:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49079f1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+6:9709:x1874699526096000:12345-192.168.204.1@tcp:36:mkdir.0 00010000:00010000:2.0:1787853071.208282:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787853071.209931:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e617c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389570 expref: 6 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853071.209964:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f4910f92200) 00010000:00010000:2.0:1787853071.210010:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787853071.210390:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e629b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853071.210406:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e629b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853071.210417:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e629b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853071.210453:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9600/0x710df789068e62a2 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853071.210461:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9600/0x710df789068e62a2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853071.210481:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9600/0x710df789068e62a2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787853071.220072:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:3.0:1787853071.220098:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e629b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853071.220110:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e629b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853071.220130:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e629b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853071.220136:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b8c00 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:3.0:1787853071.220141:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e629b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853071.220149:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e629b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853071.221798:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f4910aab400) 00010000:00010000:3.0:1787853071.221809:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787853071.221816:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e629b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853071.221826:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e629b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787853071.221857:0:5838:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008a032d6f reply state 00000000f68b0af1 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9600/0x710df789068e62a2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853071.222853:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787853071.223559:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49079f1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+7:9709:x1874699526096000:12345-192.168.204.1@tcp:36:mkdir.0 Request processed in 15360us (15765us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1787853071.223589:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 15 00010000:00010000:2.0:1787853071.231825:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9600/0x710df789068e62a2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853071.231845:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9600/0x710df789068e62a2 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853071.231852:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9600/0x710df789068e62a2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853071.231858:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b9600 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:2.0:1787853071.232777:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9600/0x710df789068e62a2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853071.232788:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9600/0x710df789068e62a2 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853071.232825:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8f4910aab700) 00010000:00010000:2.0:1787853071.232828:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787853071.232834:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9600/0x710df789068e62a2 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853071.232841:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9600/0x710df789068e62a2 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853071.237769:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853071.237972:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526096128 00000100:00100000:3.0:1787853071.237987:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526096128 00000100:00100000:3.0:1787853071.238063:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 16 00000100:00100000:3.0:1787853071.238075:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49079f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+6:9710:x1874699526096128:12345-192.168.204.1@tcp:101:chmod.0 00010000:00010000:3.0:1787853071.238120:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853071.238153:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20400/0x710df789068e62a9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c50793895f5 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853071.238260:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e62b0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853071.238279:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e62b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853071.238295:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e62b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787853071.238375:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1787853071.238380:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1787853071.238440:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e62b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853071.238471:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20400/0x710df789068e62a9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793895f5 expref: 8 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853071.238492:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e62b0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793895f5 expref: 7 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853071.238501:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f4910f92800) 00010000:00010000:3.0:1787853071.238504:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787853071.238507:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4921e20c00, rc 0) 00000100:00100000:3.0:1787853071.238806:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49079f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+7:9710:x1874699526096128:12345-192.168.204.1@tcp:101:chmod.0 Request processed in 732us (1051us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853071.238815:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 16 00000100:00100000:0.0:1787853071.247551:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853071.248266:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526096384 00000100:00100000:3.0:1787853071.248275:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526096384 00000100:00100000:3.0:1787853071.248336:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 17 00000100:00100000:3.0:1787853071.248346:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49079f0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+7:9710:x1874699526096384:12345-192.168.204.1@tcp:36:chmod.0 00010000:00010000:3.0:1787853071.248399:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787853071.248430:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e62b0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793895f5 expref: 7 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853071.248450:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f4910f92800) 00010000:00010000:3.0:1787853071.248460:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787853071.248491:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21a00/0x710df789068e62b7 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853071.248506:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21a00/0x710df789068e62b7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853071.248517:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21a00/0x710df789068e62b7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787853071.248848:0:5836:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009488ed9e reply state 00000000a95086cc transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21a00/0x710df789068e62b7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853071.248858:0:5836:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787853071.248870:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:3.0:1787853071.248966:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49079f0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+8:9710:x1874699526096384:12345-192.168.204.1@tcp:36:chmod.0 Request processed in 621us (1424us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1787853071.248974:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 17 00010000:00010000:3.0:1787853071.252136:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21a00/0x710df789068e62b7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853071.252155:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21a00/0x710df789068e62b7 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853071.252171:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21a00/0x710df789068e62b7 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853071.252179:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4921e21a00 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:3.0:1787853071.252185:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21a00/0x710df789068e62b7 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853071.252194:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21a00/0x710df789068e62b7 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853071.254062:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f4910f92d00) 00010000:00010000:3.0:1787853071.254069:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787853071.254077:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21a00/0x710df789068e62b7 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853071.254086:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21a00/0x710df789068e62b7 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853071.292549:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853071.292832:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526096512 00000100:00100000:3.0:1787853071.292851:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526096512 00000100:00100000:3.0:1787853071.292954:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 18 00000100:00100000:3.0:1787853071.292967:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49216e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+7:9711:x1874699526096512:12345-192.168.204.1@tcp:101:chown.0 00010000:00010000:3.0:1787853071.292998:0:8462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853071.293027:0:8462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21a00/0x710df789068e62be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c50793895fc expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853071.293110:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e62c5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853071.293126:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e62c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853071.293155:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e62c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787853071.293227:0:8462:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1787853071.293231:0:8462:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1787853071.293297:0:8462:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e62c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853071.293325:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21a00/0x710df789068e62be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793895fc expref: 9 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853071.293344:0:8462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e62c5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793895fc expref: 8 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853071.293354:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f4910f92d00) 00010000:00010000:3.0:1787853071.293357:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787853071.293360:0:8462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4921e20c00, rc 0) 00000100:00100000:3.0:1787853071.293431:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49216e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+8:9711:x1874699526096512:12345-192.168.204.1@tcp:101:chown.0 Request processed in 468us (904us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853071.293438:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 18 00000100:00100000:0.0:1787853071.299366:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853071.300375:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526096640 00000100:00100000:3.0:1787853071.300391:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526096640 00000100:00100000:3.0:1787853071.300486:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 19 00000100:00100000:3.0:1787853071.300497:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49216e4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+8:9711:x1874699526096640:12345-192.168.204.1@tcp:101:chown.0 00010000:00010000:3.0:1787853071.300527:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853071.300558:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20400/0x710df789068e62cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c5079389603 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853071.300704:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20e00/0x710df789068e62d3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853071.300720:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20e00/0x710df789068e62d3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853071.300736:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20e00/0x710df789068e62d3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853071.300754:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21000/0x710df789068e62da lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853071.300762:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21000/0x710df789068e62da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853071.300768:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21000/0x710df789068e62da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853071.300924:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21800/0x710df789068e62e1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853071.300933:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21800/0x710df789068e62e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853071.300940:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21800/0x710df789068e62e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787853071.300986:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:3.0:1787853071.300990:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787853071.301014:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21800/0x710df789068e62e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853071.301039:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20e00/0x710df789068e62d3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853071.301047:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20e00/0x710df789068e62d3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853071.301055:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20e00/0x710df789068e62d3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853071.301061:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4921e20e00 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:3.0:1787853071.301066:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20e00/0x710df789068e62d3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853071.301073:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20e00/0x710df789068e62d3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853071.301085:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f4910f92d00) 00010000:00010000:3.0:1787853071.301087:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787853071.301093:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20e00/0x710df789068e62d3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853071.301099:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20e00/0x710df789068e62d3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853071.301112:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21000/0x710df789068e62da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853071.301119:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21000/0x710df789068e62da lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853071.301124:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21000/0x710df789068e62da lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853071.301134:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4921e21000 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:3.0:1787853071.301137:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21000/0x710df789068e62da lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853071.301144:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21000/0x710df789068e62da lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853071.301151:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8f4910f92800) 00010000:00010000:3.0:1787853071.301154:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787853071.301156:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21000/0x710df789068e62da lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853071.301162:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21000/0x710df789068e62da lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853071.301197:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20400/0x710df789068e62cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389603 expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853071.301213:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21800/0x710df789068e62e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389603 expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853071.301221:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8f4910f92600) 00010000:00010000:3.0:1787853071.301223:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787853071.301225:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4921e21800, rc 0) 00000100:00100000:3.0:1787853071.301328:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49216e4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+9:9711:x1874699526096640:12345-192.168.204.1@tcp:101:chown.0 Request processed in 833us (1974us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853071.301336:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 19 00000100:00100000:0.0:1787853071.319011:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853071.319302:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526096896 00000100:00100000:3.0:1787853071.319337:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526096896 00000100:00100000:3.0:1787853071.319454:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 20 00000100:00100000:3.0:1787853071.319465:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49216e5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+9:9711:x1874699526096896:12345-192.168.204.1@tcp:36:chown.0 00010000:00010000:3.0:1787853071.319550:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787853071.319628:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21800/0x710df789068e62e1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389603 expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853071.319652:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8f4910f92600) 00010000:00010000:3.0:1787853071.319664:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787853071.319693:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20400/0x710df789068e62e8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853071.319707:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20400/0x710df789068e62e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853071.319718:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20400/0x710df789068e62e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787853071.348329:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:2.0:1787853071.348401:0:5837:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000055d2faf2 reply state 000000009b58fe80 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20400/0x710df789068e62e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853071.348417:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787853071.348647:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00080000:2.0:1787853071.349134:0:5837:0:(ldlm_lib.c:3492:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1787853071.349164:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49216e5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+7:9711:x1874699526096896:12345-192.168.204.1@tcp:36:chown.0 Request processed in 29696us (30157us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1787853071.349174:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 20 00010000:00010000:1.0:1787853071.349392:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20400/0x710df789068e62e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853071.349402:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20400/0x710df789068e62e8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853071.349411:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20400/0x710df789068e62e8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853071.349419:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4921e20400 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:1.0:1787853071.349424:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20400/0x710df789068e62e8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853071.349434:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20400/0x710df789068e62e8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853071.349459:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8f4910f92800) 00010000:00010000:1.0:1787853071.349462:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787853071.349468:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20400/0x710df789068e62e8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853071.349475:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20400/0x710df789068e62e8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853071.372356:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853071.373302:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526097024 00000100:00100000:3.0:1787853071.373314:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526097024 00000100:00100000:3.0:1787853071.373451:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 21 00000100:00100000:3.0:1787853071.373462:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49216e7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+6:9712:x1874699526097024:12345-192.168.204.1@tcp:101:touch.500 00010000:00010000:3.0:1787853071.373603:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853071.373625:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21800/0x710df789068e62ef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c507938960a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787853071.375294:0:5838:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 1568us 00010000:00010000:1.0:1787853071.387126:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ac200/0x710df789068e62f6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853071.387158:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ac200/0x710df789068e62f6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853071.387173:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ac200/0x710df789068e62f6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853071.387197:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad600/0x710df789068e62fd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853071.387210:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad600/0x710df789068e62fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853071.387217:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad600/0x710df789068e62fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853071.388270:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad800/0x710df789068e6304 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853071.388287:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad800/0x710df789068e6304 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853071.388298:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad800/0x710df789068e6304 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787853071.388465:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787853071.388470:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787853071.388600:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad800/0x710df789068e6304 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853071.388617:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ac200/0x710df789068e62f6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853071.388623:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ac200/0x710df789068e62f6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853071.388630:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ac200/0x710df789068e62f6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853071.388647:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f492a8ac200 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:1.0:1787853071.388653:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ac200/0x710df789068e62f6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853071.388661:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ac200/0x710df789068e62f6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853071.388676:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f4910f92d00) 00010000:00010000:1.0:1787853071.388679:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787853071.388684:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ac200/0x710df789068e62f6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853071.388691:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ac200/0x710df789068e62f6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853071.388703:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad600/0x710df789068e62fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853071.388709:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad600/0x710df789068e62fd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853071.388714:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad600/0x710df789068e62fd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853071.388718:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f492a8ad600 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:1.0:1787853071.388720:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad600/0x710df789068e62fd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853071.388730:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad600/0x710df789068e62fd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853071.388745:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8f4914d11c00) 00010000:00010000:1.0:1787853071.388748:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787853071.388750:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad600/0x710df789068e62fd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853071.388756:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad600/0x710df789068e62fd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853071.388806:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21800/0x710df789068e62ef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c507938960a expref: 8 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853071.388822:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad800/0x710df789068e6304 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c507938960a expref: 7 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853071.388829:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8f4914d11200) 00010000:00010000:1.0:1787853071.388832:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787853071.388834:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f492a8ad800, rc 0) 00000100:00100000:1.0:1787853071.388999:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49216e7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+7:9712:x1874699526097024:12345-192.168.204.1@tcp:101:touch.500 Request processed in 15539us (16652us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853071.389009:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 21 00000100:00100000:2.0:1787853071.392651:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853071.392777:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526097280 00000100:00100000:0.0:1787853071.392865:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526097280 00000100:00100000:0.0:1787853071.392993:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 22 00000100:00100000:0.0:1787853071.393004:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493c5a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+7:9712:x1874699526097280:12345-192.168.204.1@tcp:101:touch.500 00010000:00010000:0.0:1787853071.393026:0:8462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853071.393054:0:8462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49029cde00/0x710df789068e630b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c5079389611 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853071.393497:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49029cc000/0x710df789068e6312 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853071.393514:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49029cc000/0x710df789068e6312 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853071.393528:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49029cc000/0x710df789068e6312 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853071.393598:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49029cd200/0x710df789068e6319 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853071.393608:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49029cd200/0x710df789068e6319 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853071.393615:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49029cd200/0x710df789068e6319 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787853071.396599:0:8462:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:0.0:1787853071.396995:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49029cc200/0x710df789068e6320 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853071.397014:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49029cc200/0x710df789068e6320 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853071.397029:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49029cc200/0x710df789068e6320 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853071.397080:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49029cc000/0x710df789068e6312 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853071.397100:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49029cc000/0x710df789068e6312 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853071.397107:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49029cc000/0x710df789068e6312 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853071.397114:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49029cc000 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:0.0:1787853071.397119:0:8462:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49029cc000/0x710df789068e6312 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853071.397127:0:8462:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49029cc000/0x710df789068e6312 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853071.397143:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8f4914d11200) 00010000:00010000:0.0:1787853071.397146:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787853071.397151:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49029cc000/0x710df789068e6312 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853071.397158:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49029cc000/0x710df789068e6312 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787853071.397175:0:8462:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f9ea2bc7 reply state 000000002246fe92 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff8f49029cd200/0x710df789068e6319 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853071.397185:0:8462:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787853071.397227:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49029cde00/0x710df789068e630b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389611 expref: 10 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853071.397245:0:8462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49029cc200/0x710df789068e6320 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389611 expref: 9 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853071.397264:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8f491176b700) 00010000:00010000:0.0:1787853071.397266:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787853071.397269:0:8462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49029cc200, rc 0) 00000100:00100000:0.0:1787853071.397372:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493c5a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+10:9712:x1874699526097280:12345-192.168.204.1@tcp:101:touch.500 Request processed in 4370us (4808us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1787853071.397382:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 22 00010000:00010000:1.0:1787853071.405872:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49029cd200/0x710df789068e6319 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853071.405887:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00010000:00010000:1.0:1787853071.405907:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49029cd200/0x710df789068e6319 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853071.405919:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49029cd200/0x710df789068e6319 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853071.405955:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49029cd200 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:1.0:1787853071.405964:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49029cd200/0x710df789068e6319 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853071.405975:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49029cd200/0x710df789068e6319 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853071.406005:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x9f0a7a27 (ffff8f491176b900) 00010000:00010000:1.0:1787853071.406009:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787853071.406016:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49029cd200/0x710df789068e6319 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853071.406024:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49029cd200/0x710df789068e6319 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853071.406616:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526097536 00000100:00100000:3.0:1787853071.406642:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526097536 00000100:00100000:3.0:1787853071.406725:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 23 00000100:00100000:3.0:1787853071.406738:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493c5a7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+9:9712:x1874699526097536:12345-192.168.204.1@tcp:36:touch.500 00010000:00010000:3.0:1787853071.406832:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787853071.406863:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49029cc200/0x710df789068e6320 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389611 expref: 9 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853071.406890:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8f491176b700) 00010000:00010000:3.0:1787853071.406912:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787853071.406978:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21000/0x710df789068e632e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853071.406994:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21000/0x710df789068e632e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853071.407007:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21000/0x710df789068e632e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787853071.409929:0:5836:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000948095aa reply state 00000000ac3fa4ee transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21000/0x710df789068e632e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853071.409954:0:5836:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787853071.410168:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493c5a7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+10:9712:x1874699526097536:12345-192.168.204.1@tcp:36:touch.500 Request processed in 3425us (4291us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1787853071.410180:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 23 00010000:00010000:0.0:1787853071.412914:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21000/0x710df789068e632e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853071.412941:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21000/0x710df789068e632e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853071.412949:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21000/0x710df789068e632e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853071.412957:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4921e21000 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:0.0:1787853071.412964:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21000/0x710df789068e632e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853071.412974:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21000/0x710df789068e632e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853071.413006:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8f4910f92600) 00010000:00010000:0.0:1787853071.413010:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787853071.413018:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21000/0x710df789068e632e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853071.413025:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21000/0x710df789068e632e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853071.415033:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853071.415155:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526097664 00000100:00100000:3.0:1787853071.415176:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526097664 00000100:00100000:3.0:1787853071.415402:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 24 00000100:00100000:3.0:1787853071.415419:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493c5a61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+9:9712:x1874699526097664:12345-192.168.204.1@tcp:101:touch.500 00010000:00010000:3.0:1787853071.415460:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853071.415530:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20e00/0x710df789068e6335 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c5079389618 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853071.416369:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20e00/0x710df789068e6335 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389618 expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853071.416399:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20e00/0x710df789068e6335 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389618 expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853071.416428:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8f4910f92200) 00010000:00010000:3.0:1787853071.416432:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787853071.416444:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4921e20e00, rc 0) 00000100:00100000:3.0:1787853071.416546:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493c5a61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+10:9712:x1874699526097664:12345-192.168.204.1@tcp:101:touch.500 Request processed in 1131us (1530us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853071.416557:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 24 00000100:00100000:3.0:1787853071.425100:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853071.425220:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526097792 00000100:00100000:0.0:1787853071.425242:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526097792 00000100:00100000:0.0:1787853071.425380:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 17 00000100:00100000:0.0:1787853071.425390:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49065d43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2361:x1874699526097792:12345-192.168.204.1@tcp:8:touch.500 00010000:00080000:0.0:1787853071.425433:0:8463:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0000: connection from b1d98f5a-0be0-4f69-83a6-833c935c8205@192.168.204.1@tcp t0 exp 0000000000000000 cur 390 last 0 00000020:00000080:0.0:1787853071.425476:0:8463:0:(genops.c:1385:class_connect()) connect: client b1d98f5a-0be0-4f69-83a6-833c935c8205, cookie 0x710df789068e633c 00002000:00100000:0.0:1787853071.425489:0:8463:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli b1d98f5a-0be0-4f69-83a6-833c935c8205/ffff8f4934308800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113954 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787853071.425503:0:8463:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787853071.425866:0:8463:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787853071.425915:0:8463:0:(import.c:65:import_set_state_nolock()) ffff8f493430c800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787853071.426000:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49065d43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+6:2361:x1874699526097792:12345-192.168.204.1@tcp:8:touch.500 Request processed in 609us (918us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853071.426008:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 17 00000100:00100000:0.0:1787853071.435293:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853071.435436:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526097920 00000100:00100000:2.0:1787853071.435452:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526097920 00000100:00100000:2.0:1787853071.435706:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 18 00000100:00100000:2.0:1787853071.435722:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4910d10780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+6:0:x1874699526097920:12345-192.168.204.1@tcp:2:touch.500 00000100:00080000:0.0:1787853071.436357:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787853071.471167:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4910d10780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+7:0:x1874699526097920:12345-192.168.204.1@tcp:2:touch.500 Request processed in 35440us (35885us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1787853071.471180:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 18 00000001:00100000:3.0:1787853071.472184:0:6712:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b1d98f5a-0be0-4f69-83a6-833c935c8205 00000001:00080000:3.0:1787853071.472202:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:3.0:1787853071.478418:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853071.478904:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526098176 00000100:00100000:2.0:1787853071.478930:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526098176 00000100:00100000:2.0:1787853071.479038:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 2 00000100:00100000:2.0:1787853071.479051:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49065d70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+10:9712:x1874699526098176:12345-192.168.204.1@tcp:35:touch.500 00000100:00100000:2.0:1787853071.479445:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49065d70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+11:9712:x1874699526098176:12345-192.168.204.1@tcp:35:touch.500 Request processed in 396us (1039us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1787853071.479454:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 2 00000100:00100000:1.0:1787853071.517376:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853071.521250:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526098304 00000100:00100000:3.0:1787853071.521266:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526098304 00000100:00100000:3.0:1787853071.521427:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 25 00000100:00100000:3.0:1787853071.521439:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493fd552c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+11:9713:x1874699526098304:12345-192.168.204.1@tcp:101:rm.0 00010000:00010000:3.0:1787853071.521471:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853071.521519:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21a00/0x710df789068e6343 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c507938961f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853071.521625:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21600/0x710df789068e634a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853071.521654:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21600/0x710df789068e634a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853071.521669:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21600/0x710df789068e634a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787853071.521737:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787853071.521741:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787853071.521787:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21600/0x710df789068e634a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853071.521814:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21a00/0x710df789068e6343 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c507938961f expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853071.521831:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21600/0x710df789068e634a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c507938961f expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853071.521840:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8f4914d11200) 00010000:00010000:3.0:1787853071.521843:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787853071.521848:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4921e21600, rc 0) 00000100:00100000:3.0:1787853071.521936:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493fd552c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+12:9713:x1874699526098304:12345-192.168.204.1@tcp:101:rm.0 Request processed in 499us (4571us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853071.521943:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 25 00000100:00100000:1.0:1787853071.538474:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853071.538925:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526098560 00000100:00100000:0.0:1787853071.538936:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526098560 00000100:00100000:0.0:1787853071.539068:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 26 00000100:00100000:0.0:1787853071.539080:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493fd56580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+12:9713:x1874699526098560:12345-192.168.204.1@tcp:101:rm.0 00010000:00010000:0.0:1787853071.539109:0:8462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853071.539134:0:8462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49029cc000/0x710df789068e6351 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c5079389626 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787853071.539290:0:8462:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:0.0:1787853071.539506:0:8462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49029cc000/0x710df789068e6351 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389626 expref: 14 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853071.539530:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f4910f92d00) 00010000:00010000:0.0:1787853071.539534:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787853071.539540:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49029cc000/0x710df789068e6351 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389626 expref: 14 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853071.539556:0:8462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49029cc000, rc 0) 00000100:00100000:0.0:1787853071.539694:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493fd56580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+13:9713:x1874699526098560:12345-192.168.204.1@tcp:101:rm.0 Request processed in 616us (1236us total) trans 4294967303 rc 301/301 00000100:00100000:0.0:1787853071.539702:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 26 00000100:00100000:2.0:1787853071.556463:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853071.556661:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526098688 00000100:00100000:0.0:1787853071.556672:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526098688 00000100:00100000:0.0:1787853071.556730:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 3 00000100:00100000:0.0:1787853071.556742:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493c5a70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+13:9713:x1874699526098688:12345-192.168.204.1@tcp:37:rm.0 00000100:00100000:3.0:1787853071.582293:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493c5a70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+13:9713:x1874699526098688:12345-192.168.204.1@tcp:37:rm.0 Request processed in 24592us (24885us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853071.582307:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 3 00000100:00100000:1.0:1787853071.592434:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853071.592927:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526098944 00000100:00100000:2.0:1787853071.592937:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526098944 00000100:00100000:2.0:1787853071.593046:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 4 00000100:00100000:2.0:1787853071.593058:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4910409c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+13:9713:x1874699526098944:12345-192.168.204.1@tcp:35:rm.0 00000100:00100000:2.0:1787853071.593353:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4910409c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+14:9713:x1874699526098944:12345-192.168.204.1@tcp:35:rm.0 Request processed in 297us (929us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1787853071.593360:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 4 00000100:00100000:3.0:1787853071.600398:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853071.600493:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526099200 00000100:00100000:1.0:1787853071.600510:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526099200 00000100:00100000:1.0:1787853071.600599:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 27 00000100:00100000:1.0:1787853071.600611:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49065d5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+14:9713:x1874699526099200:12345-192.168.204.1@tcp:101:rm.0 00010000:00010000:1.0:1787853071.600647:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853071.600669:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ade00/0x710df789068e635f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c507938962d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853071.600798:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad000/0x710df789068e6366 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853071.600830:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad000/0x710df789068e6366 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853071.600843:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad000/0x710df789068e6366 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787853071.600856:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:1.0:1787853071.600995:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ade00/0x710df789068e635f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c507938962d expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853071.601019:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad000/0x710df789068e6366 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c507938962d expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853071.601029:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8f4914d11200) 00010000:00010000:1.0:1787853071.601032:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787853071.601257:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f492a8ad000, rc 0) 00000100:00100000:1.0:1787853071.601330:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49065d5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+16:9713:x1874699526099200:12345-192.168.204.1@tcp:101:rm.0 Request processed in 722us (942us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1787853071.601339:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 27 00000100:00100000:1.0:1787853071.612184:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853071.612291:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526099328 00000100:00100000:3.0:1787853071.612315:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526099328 00000100:00100000:3.0:1787853071.612496:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 28 00000100:00100000:3.0:1787853071.612509:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493fd55a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+16:9713:x1874699526099328:12345-192.168.204.1@tcp:41:rm.0 00000004:00000024:3.0:1787853071.612600:0:5837:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:3.0:1787853071.613007:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493fd55a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+16:9713:x1874699526099328:12345-192.168.204.1@tcp:41:rm.0 Request processed in 500us (829us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853071.613016:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 28 00000100:00100000:3.0:1787853071.615075:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853071.615318:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526099456 00000100:00100000:0.0:1787853071.615328:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526099456 00000100:00100000:0.0:1787853071.615385:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 29 00000100:00100000:0.0:1787853071.615394:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49065d6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+16:9713:x1874699526099456:12345-192.168.204.1@tcp:101:rm.0 00010000:00010000:0.0:1787853071.615414:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853071.615436:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49029cc000/0x710df789068e6374 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c5079389634 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853071.615497:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49029cd200/0x710df789068e637b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853071.615512:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49029cd200/0x710df789068e637b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853071.615549:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49029cd200/0x710df789068e637b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853071.615588:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49029cde00/0x710df789068e6382 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853071.615595:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49029cde00/0x710df789068e6382 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853071.615600:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49029cde00/0x710df789068e6382 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853071.615980:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49029cc200/0x710df789068e6389 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853071.615987:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49029cc200/0x710df789068e6389 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853071.615992:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49029cc200/0x710df789068e6389 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787853071.616014:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:0.0:1787853071.616017:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787853071.616034:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f49029cc200/0x710df789068e6389 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853071.616046:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49029cc200/0x710df789068e6389 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853071.616055:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49029cd200/0x710df789068e637b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853071.616071:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49029cd200/0x710df789068e637b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853071.616076:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49029cd200/0x710df789068e637b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853071.616081:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49029cd200 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:0.0:1787853071.616084:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49029cd200/0x710df789068e637b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853071.616089:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49029cd200/0x710df789068e637b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853071.616099:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8f4914d11200) 00010000:00010000:0.0:1787853071.616101:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787853071.616104:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49029cd200/0x710df789068e637b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853071.616108:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49029cd200/0x710df789068e637b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853071.616119:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49029cde00/0x710df789068e6382 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853071.616123:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49029cde00/0x710df789068e6382 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853071.616127:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49029cde00/0x710df789068e6382 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853071.616129:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49029cde00 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:0.0:1787853071.616135:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49029cde00/0x710df789068e6382 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853071.616139:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49029cde00/0x710df789068e6382 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853071.616143:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x9f0a7a27 (ffff8f491176b300) 00010000:00010000:0.0:1787853071.616155:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787853071.616157:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49029cde00/0x710df789068e6382 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853071.616164:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49029cde00/0x710df789068e6382 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853071.616196:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49029cc000/0x710df789068e6374 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389634 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853071.616205:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49029cc200/0x710df789068e6389 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389634 expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853071.616210:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8f4910f92200) 00010000:00010000:0.0:1787853071.616212:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787853071.616213:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49029cc200, rc 0) 00000100:00100000:0.0:1787853071.616273:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49065d6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+17:9713:x1874699526099456:12345-192.168.204.1@tcp:101:rm.0 Request processed in 880us (1205us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853071.616280:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 29 00000100:00100000:2.0:1787853071.620131:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853071.620463:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526099712 00000100:00100000:0.0:1787853071.620473:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526099712 00000100:00100000:0.0:1787853071.620927:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 30 00000100:00100000:0.0:1787853071.620940:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493c5a70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+17:9713:x1874699526099712:12345-192.168.204.1@tcp:36:rm.0 00010000:00010000:0.0:1787853071.621026:0:8462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787853071.621055:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49029cc200/0x710df789068e6389 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389634 expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853071.621078:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20e00/0x710df789068e6335 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389618 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853071.621088:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8f4910f92200) 00010000:00010000:0.0:1787853071.621115:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21600/0x710df789068e634a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c507938961f expref: 15 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853071.621124:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8f4914d11200) 00010000:00010000:0.0:1787853071.621128:0:8462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787853071.621158:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49029cc400/0x710df789068e6390 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853071.621172:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49029cc400/0x710df789068e6390 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853071.621182:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49029cc400/0x710df789068e6390 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853071.621197:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49029cd600/0x710df789068e6397 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853071.621204:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49029cd600/0x710df789068e6397 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853071.621210:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49029cd600/0x710df789068e6397 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853071.621347:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7800/0x710df789068e639e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853071.621355:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7800/0x710df789068e639e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853071.621362:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7800/0x710df789068e639e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787853071.622510:0:8462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:0.0:1787853071.622523:0:8462:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 391163951721ns, next at 392163949403ns, rc = 0 00010000:00010000:0.0:1787853071.623233:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7600/0x710df789068e63a5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853071.623249:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7600/0x710df789068e63a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853071.623260:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7600/0x710df789068e63a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853071.623267:0:8462:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7600/0x710df789068e63a5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853071.623273:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7600/0x710df789068e63a5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853071.623279:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7600/0x710df789068e63a5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853071.623304:0:8462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787853071.623340:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7800/0x710df789068e639e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853071.623359:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7800/0x710df789068e639e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853071.623365:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7800/0x710df789068e639e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853071.623372:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b7800 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:0.0:1787853071.623377:0:8462:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7800/0x710df789068e639e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853071.623385:0:8462:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7800/0x710df789068e639e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853071.623396:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8f491176bf00) 00010000:00010000:0.0:1787853071.623399:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787853071.623402:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7800/0x710df789068e639e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853071.623406:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7800/0x710df789068e639e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853071.623421:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49029cc400/0x710df789068e6390 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853071.623425:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49029cc400/0x710df789068e6390 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853071.623428:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49029cc400/0x710df789068e6390 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853071.623431:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49029cc400 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:0.0:1787853071.623437:0:8462:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49029cc400/0x710df789068e6390 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853071.623442:0:8462:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49029cc400/0x710df789068e6390 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853071.623446:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8f4914d11200) 00010000:00010000:0.0:1787853071.623448:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787853071.623449:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49029cc400/0x710df789068e6390 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853071.623453:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49029cc400/0x710df789068e6390 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787853071.623461:0:8462:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000023ea475b reply state 00000000f21950f6 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff8f49029cd600/0x710df789068e6397 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853071.623467:0:8462:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787853071.623657:0:8449:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787853071.623664:0:8449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7600/0x710df789068e63a5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853071.623671:0:8449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b7600 already unused, calling callback (ffffffffc1528440) 00010000:00010000:3.0:1787853071.623674:0:8449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7600/0x710df789068e63a5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853071.623681:0:8449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7600/0x710df789068e63a5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853071.623698:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8f491176bf00) 00010000:00010000:3.0:1787853071.623701:0:8449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787853071.623704:0:8449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7600/0x710df789068e63a5 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853071.623709:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7600/0x710df789068e63a5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853071.623724:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787853071.623725:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787853071.623727:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787853071.623906:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493c5a70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+16:9713:x1874699526099712:12345-192.168.204.1@tcp:36:rm.0 Request processed in 2885us (3701us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1787853071.623916:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 30 00010000:00010000:3.0:1787853071.626467:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49029cd600/0x710df789068e6397 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853071.626485:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49029cd600/0x710df789068e6397 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853071.626493:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49029cd600/0x710df789068e6397 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853071.626511:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49029cd600 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:3.0:1787853071.626517:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49029cd600/0x710df789068e6397 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853071.626526:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49029cd600/0x710df789068e6397 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853071.626545:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x9f0a7a27 (ffff8f491176bb00) 00010000:00010000:3.0:1787853071.626549:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787853071.626554:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49029cd600/0x710df789068e6397 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853071.626560:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49029cd600/0x710df789068e6397 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853071.628408:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853071.628517:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526099968 00000100:00100000:3.0:1787853071.628529:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526099968 00000100:00100000:3.0:1787853071.628626:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 5 00000100:00100000:3.0:1787853071.628637:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493c5a4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+15:9713:x1874699526099968:12345-192.168.204.1@tcp:35:rm.0 00000100:00100000:3.0:1787853071.628955:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493c5a4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+16:9713:x1874699526099968:12345-192.168.204.1@tcp:35:rm.0 Request processed in 319us (556us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1787853071.628963:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 5 00000100:00100000:1.0:1787853071.632964:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853071.633062:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526100224 00000100:00100000:3.0:1787853071.633073:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526100224 00000100:00100000:3.0:1787853071.633137:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 31 00000100:00100000:3.0:1787853071.633146:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493fd54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+16:9713:x1874699526100224:12345-192.168.204.1@tcp:36:rm.0 00010000:00010000:3.0:1787853071.633210:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787853071.633239:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad000/0x710df789068e6366 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c507938962d expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853071.633258:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad800/0x710df789068e6304 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c507938960a expref: 15 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853071.633267:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8f4914d11200) 00010000:00010000:3.0:1787853071.633281:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e62c5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793895fc expref: 14 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853071.633289:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f4910f92d00) 00010000:00010000:3.0:1787853071.633294:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787853071.633316:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21a00/0x710df789068e63ac lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853071.633328:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21a00/0x710df789068e63ac lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853071.633347:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21a00/0x710df789068e63ac lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853071.633359:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20200/0x710df789068e63b3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853071.633366:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20200/0x710df789068e63b3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853071.633387:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20200/0x710df789068e63b3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853071.634455:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21600/0x710df789068e63ba lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853071.634470:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21600/0x710df789068e63ba lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853071.634479:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21600/0x710df789068e63ba lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787853071.635470:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:3.0:1787853071.635562:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21600/0x710df789068e63ba lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853071.635849:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21600/0x710df789068e63ba lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853071.635857:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21600/0x710df789068e63ba lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853071.635864:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4921e21600 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:3.0:1787853071.635868:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21600/0x710df789068e63ba lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853071.635876:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21600/0x710df789068e63ba lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853071.635913:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8f4910f92400) 00010000:00010000:3.0:1787853071.635917:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787853071.635932:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21600/0x710df789068e63ba lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853071.635938:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21600/0x710df789068e63ba lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853071.635963:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21a00/0x710df789068e63ac lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853071.635970:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21a00/0x710df789068e63ac lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853071.635976:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21a00/0x710df789068e63ac lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853071.635981:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4921e21a00 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:3.0:1787853071.635984:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21a00/0x710df789068e63ac lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853071.635989:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21a00/0x710df789068e63ac lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853071.635997:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f4910f92300) 00010000:00010000:3.0:1787853071.635999:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787853071.636002:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21a00/0x710df789068e63ac lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853071.636008:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21a00/0x710df789068e63ac lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787853071.636020:0:5836:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e9f7c469 reply state 0000000015ed8575 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20200/0x710df789068e63b3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853071.636039:0:5836:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787853071.636468:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493fd54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+15:9713:x1874699526100224:12345-192.168.204.1@tcp:36:rm.0 Request processed in 3317us (3509us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1787853071.636487:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 31 00010000:00010000:0.0:1787853071.644644:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20200/0x710df789068e63b3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853071.644662:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20200/0x710df789068e63b3 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853071.644669:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20200/0x710df789068e63b3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853071.644809:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4921e20200 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:0.0:1787853071.644815:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20200/0x710df789068e63b3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853071.644839:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20200/0x710df789068e63b3 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853071.644856:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8f4910f92c00) 00010000:00010000:0.0:1787853071.644859:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787853071.644865:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20200/0x710df789068e63b3 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853071.644872:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20200/0x710df789068e63b3 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853072.171313:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787853072.706256:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853072.706345:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853072.706377:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853072.706416:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853072.706467:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526100480 00000100:00100000:1.0:1787853072.706477:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526100480 00000100:00100000:1.0:1787853072.706640:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526100736 00000100:00100000:1.0:1787853072.706671:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526100736 00000100:00100000:1.0:1787853072.706711:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 115 00000100:00100000:1.0:1787853072.706721:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f494159d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+14:2365:x1874699526100480:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:1.0:1787853072.706812:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f494159d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+14:2365:x1874699526100480:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 92us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853072.706821:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 115 00000100:00100000:1.0:1787853072.706841:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 116 00000100:00100000:1.0:1787853072.706849:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49415a4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ea3b4e1-e827-460f-be07-19e86dff3d79+5:2365:x1874699526100736:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:1.0:1787853072.706890:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49415a4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ea3b4e1-e827-460f-be07-19e86dff3d79+5:2365:x1874699526100736:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 42us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853072.706897:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 116 00000100:00080000:1.0:1787853072.706918:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787853072.707233:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526100608 00000100:00100000:2.0:1787853072.707239:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526100608 00000100:00100000:2.0:1787853072.707289:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 66 00000100:00100000:2.0:1787853072.707298:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493fd543c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+5:2365:x1874699526100608:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:2.0:1787853072.707353:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493fd543c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+5:2365:x1874699526100608:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 57us (1008us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853072.707360:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 66 00000100:00100000:0.0:1787853072.714974:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526100352 00000100:00100000:0.0:1787853072.714988:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526100352 00000100:00100000:0.0:1787853072.715058:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 256 00000100:00100000:0.0:1787853072.715068:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4904f57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af755b38-4932-400a-92cc-ddad0ca077a5+13:2365:x1874699526100352:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:0.0:1787853072.715160:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4904f57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af755b38-4932-400a-92cc-ddad0ca077a5+13:2365:x1874699526100352:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 92us (8916us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853072.715168:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 256 00010000:00010000:0.0:1787853073.197358:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787853074.217953:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787853075.181106:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49415a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874699552351872:0@lo:400:kworker.0 00000100:00100000:1.0:1787853075.181141:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49415a6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1874699552352128:0@lo:400:kworker.0 00000100:00100000:3.0:1787853075.181162:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49415a70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552352000:0@lo:400:kworker.0 00000100:00100000:2.0:1787853075.181182:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853075.181235:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552351872 00000100:00100000:1.0:1787853075.181243:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552351872 00000100:00100000:1.0:1787853075.181295:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1787853075.181304:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493c5a43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874699552351872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853075.181380:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49415a4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5d48a955-7010-4118-9c7d-f396984ae1ff:3308:1874699552351744:0@lo:400:kworker.0 00000100:00100000:3.0:1787853075.183334:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853075.183458:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552352000 00000100:00100000:3.0:1787853075.183466:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552352000 00000100:00100000:3.0:1787853075.183562:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787853075.183594:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49065d6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874699552352000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853075.183665:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49065d6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874699552352000:12345-0@lo:400:kworker.0 Request processed in 95us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853075.183672:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:3.0:1787853075.183816:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787853075.183883:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f49415a70c0 x1874699552352000/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787853091 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787853075.183899:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49415a70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552352000:0@lo:400:kworker.0 00000100:00100000:3.0:1787853075.184022:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853075.184075:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552352128 00000100:00100000:3.0:1787853075.184080:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552352128 00000100:00100000:3.0:1787853075.184304:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1787853075.184313:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49065d6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874699552352128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853075.184356:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49065d6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874699552352128:12345-0@lo:400:kworker.0 Request processed in 45us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853075.184376:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00080000:3.0:1787853075.184398:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787853075.184418:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49415a6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1874699552352128:0@lo:400:kworker.0 00000100:00100000:2.0:1787853075.186282:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4934235a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874699552352384:0@lo:400:kworker.0 00000100:00100000:2.0:1787853075.186342:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853075.186351:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493c5a43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874699552351872:12345-0@lo:400:kworker.0 Request processed in 5044us (5164us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853075.186361:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1787853075.186459:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49415a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874699552351872:0@lo:400:kworker.0 00000100:00100000:0.0:1787853075.186467:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853075.186556:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49415a52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1874699552352256:0@lo:400:kworker.0 00000100:00100000:0.0:1787853075.186605:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853075.186665:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552352256 00000100:00100000:0.0:1787853075.186671:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552352256 00000100:00100000:0.0:1787853075.186938:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1787853075.186950:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4910d13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874699552352256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853075.187018:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4910d13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874699552352256:12345-0@lo:400:kworker.0 Request processed in 71us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853075.187025:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00080000:0.0:1787853075.187048:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787853075.187071:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49415a52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1874699552352256:0@lo:400:kworker.0 00000100:00100000:1.0:1787853075.187146:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552351744 00000100:00100000:1.0:1787853075.187150:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552351744 00000100:00100000:1.0:1787853075.187276:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1787853075.187284:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4904f54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+19:3308:x1874699552351744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853075.187321:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4904f54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+19:3308:x1874699552351744:12345-0@lo:400:kworker.0 Request processed in 38us (857us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853075.187336:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1787853075.187387:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49415a4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5d48a955-7010-4118-9c7d-f396984ae1ff:3308:1874699552351744:0@lo:400:kworker.0 00000100:00100000:3.0:1787853075.192660:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552352384 00000100:00100000:3.0:1787853075.192675:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552352384 00000100:00100000:3.0:1787853075.192769:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787853075.192781:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493c5a52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1874699552352384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853075.192907:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493c5a52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1874699552352384:12345-0@lo:400:kworker.0 Request processed in 129us (6566us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853075.192916:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00080000:2.0:1787853075.193335:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f4934235a40 x1874699552352384/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787853091 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787853075.193352:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4934235a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874699552352384:0@lo:400:kworker.0 00000100:00080000:0.0:1787853075.193881:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787853075.246782:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787853075.691596:0:6701:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 395233023093ns, next at 396233020650ns, rc = 0 00000100:00100000:2.0:1787853075.691618:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787853075.691639:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f493c5a7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874699552352512:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787853075.691705:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853075.691773:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552352512 00000100:00100000:2.0:1787853075.691782:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552352512 00000100:00100000:2.0:1787853075.691842:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787853075.691852:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493c5a6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874699552352512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787853075.691899:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787853075.691943:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493c5a6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874699552352512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853075.691951:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:2.0:1787853075.691991:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f493c5a7c00 x1874699552352512/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787853091 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787853075.692009:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f493c5a7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874699552352512:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787853075.693151:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787853075.693168:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49065d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552352640:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787853075.693227:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853075.693273:0:10348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552352640 00000100:00100000:3.0:1787853075.693279:0:10348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552352640 00000100:00100000:3.0:1787853075.693313:0:10348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787853075.693321:0:10348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49065d7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874699552352640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787853075.693346:0:10348:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787853075.693382:0:10348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49065d7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874699552352640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853075.693389:0:10348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:3.0:1787853075.693426:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f49065d7480 x1874699552352640/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787853091 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787853075.693442:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49065d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552352640:0@lo:13:osp-pre-1-0.0 00000001:02000400:1.0:1787853076.150890:0:11621:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:1.0:1787853076.267367:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787853076.847051:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967306 is committed 00000004:00080000:1.0:1787853076.847076:0:5858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000004:00080000:1.0:1787853076.847095:0:5858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:1.0:1787853076.847108:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000100:00100000:1.0:1787853076.847232:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4934234000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874699552352768:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787853076.847300:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853076.847667:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552352768 00000100:00100000:3.0:1787853076.847674:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552352768 00000100:00100000:3.0:1787853076.847730:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787853076.847740:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4934234b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1874699552352768:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1787853076.847783:0:6681:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:3.0:1787853076.847833:0:6681:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a90790f, atime: 0x6a90790f, ctime: 0x6a90790f, blocks: 0x1 00010000:00010000:3.0:1787853076.847841:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8fa5a29/0x710df789068e63c1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853076.847859:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=396s v=(0 0) 00010000:00010000:3.0:1787853076.847863:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787853076.847869:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8fa5a29/0x710df789068e63c1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853076.847886:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d8fa5a29/0x710df789068e63c1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853076.847897:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8fa5a29/0x710df789068e63c1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853076.847906:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d8fa5a29/0x710df789068e63c1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853076.847925:0:6681:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787853076.849247:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4934234b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3308:x1874699552352768:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1504us (1943us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1787853076.849260:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00010000:3.0:1787853076.849292:0:8449:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787853076.849300:0:8449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d8fa5a29/0x710df789068e63c1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853076.849323:0:8449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4921e21600 already unused, calling callback (ffffffffc1528440) 00010000:00010000:3.0:1787853076.849327:0:8449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8fa5a29/0x710df789068e63c1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853076.849338:0:8449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8fa5a29/0x710df789068e63c1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853076.849356:0:8449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d8fa5a29/0x710df789068e63c1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853076.849364:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d8fa5a29/0x710df789068e63c1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853076.849385:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787853076.849386:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787853076.849388:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1787853076.849962:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8f4934234000/2, rc 0, transno 4294967300 00000100:00100000:3.0:1787853076.849970:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4934234000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874699552352768:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1787853077.293449:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787853077.720450:0:11671:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff53d1ce80 20000000:00000080:1.0:1787853077.720469:0:11671:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8f493ffc8000 uarg=0000000000000000 20000000:01000000:1.0:1787853077.720506:0:11671:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1787853077.720513:0:11671:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1787853077.720518:0:11671:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:3.0:1787853077.721228:0:11672:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:1.0:1787853077.721396:0:11671:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:0.0:1787853077.735033:0:11671:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:0.0:1787853077.735086:0:11671:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:0.0:1787853077.735134:0:11671:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:0.0:1787853077.735155:0:11671:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787853077.735175:0:11671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f49415b6a00/0x710df789068e63c8 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853077.735193:0:11671:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f4900030400/0x710df789068e626a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x710df789068e6263 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853077.735201:0:11671:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f492a8ac800/0x710df789068e6278 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x710df789068e6271 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853077.735207:0:11671:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f49415b9200/0x710df789068e6286 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x710df789068e627f expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853077.735216:0:11671:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f492a8ac600/0x710df789068e628d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793895e7 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853077.735223:0:11671:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f492a8ace00/0x710df789068e6294 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793895ee expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853077.735242:0:11671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f49415b6a00/0x710df789068e63c8 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853077.735282:0:11671:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f492a8ace00/0x710df789068e6294 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793895ee expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853077.735298:0:11671:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f492a8ace00/0x710df789068e6294 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793895ee expref: 12 pid: 5829 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853077.735312:0:11671:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4910d121c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11671:1874699552352896:192.168.204.1@tcp:104: 00010000:00010000:0.0:1787853077.737288:0:11671:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f492a8ac600/0x710df789068e628d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793895e7 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853077.737308:0:11671:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f492a8ac600/0x710df789068e628d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793895e7 expref: 12 pid: 5831 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853077.737323:0:11671:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4910d10f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11671:1874699552353024:192.168.204.1@tcp:104: 00010000:00010000:0.0:1787853077.737445:0:11671:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f49415b9200/0x710df789068e6286 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x710df789068e627f expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853077.737454:0:11671:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f49415b9200/0x710df789068e6286 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x710df789068e627f expref: 18 pid: 5830 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853077.737464:0:11671:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4910d12580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11671:1874699552353152:0@lo:104: 00000100:00100000:0.0:1787853077.737509:0:11671:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787853077.737736:0:11671:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f492a8ac800/0x710df789068e6278 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x710df789068e6271 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853077.737762:0:11671:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f492a8ac800/0x710df789068e6278 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x710df789068e6271 expref: 18 pid: 5830 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853077.737783:0:11671:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4910d112c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11671:1874699552353280:0@lo:104: 00000100:00100000:0.0:1787853077.737815:0:11671:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787853077.741705:0:11671:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f4900030400/0x710df789068e626a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x710df789068e6263 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853077.741724:0:11671:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f4900030400/0x710df789068e626a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x710df789068e6263 expref: 18 pid: 5831 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853077.741738:0:11671:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4910d11e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11671:1874699552353408:0@lo:104: 00000100:00100000:0.0:1787853077.741792:0:11671:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f49012ed000 going to sleep for 11 seconds 00000100:00100000:2.0:1787853077.742344:0:7630:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787853077.742372:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853077.742408:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552353152 00000100:00100000:2.0:1787853077.742416:0:7630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552353152 00000100:00100000:2.0:1787853077.742462:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552353280 00000100:00100000:2.0:1787853077.742464:0:7630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552353280 00000100:00100000:2.0:1787853077.742475:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552353408 00000100:00100000:2.0:1787853077.742478:0:7630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552353408 00000100:00100000:2.0:1787853077.742490:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787853077.742498:0:7630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4910d13c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:5d48a955-7010-4118-9c7d-f396984ae1ff+5:11671:x1874699552353152:12345-0@lo:104: 00010000:00010000:2.0:1787853077.742511:0:7630:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.101@tcp lock: ffff8f4900031a00/0x710df789068e627f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x710df789068e6286 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853077.742599:0:7630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787853077.742604:0:7630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4910d13c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:5d48a955-7010-4118-9c7d-f396984ae1ff+5:11671:x1874699552353152:12345-0@lo:104: Request processed in 108us (5096us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853077.742610:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787853077.742626:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787853077.742632:0:7630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493c74c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:5d48a955-7010-4118-9c7d-f396984ae1ff+4:11671:x1874699552353280:12345-0@lo:104: 00010000:00010000:2.0:1787853077.742639:0:7630:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.101@tcp lock: ffff8f4900030200/0x710df789068e6271 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x710df789068e6278 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853077.742673:0:7630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787853077.742677:0:7630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493c74c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:5d48a955-7010-4118-9c7d-f396984ae1ff+4:11671:x1874699552353280:12345-0@lo:104: Request processed in 47us (4862us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853077.742683:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787853077.742712:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787853077.742717:0:7630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493c5a6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:5d48a955-7010-4118-9c7d-f396984ae1ff+3:11671:x1874699552353408:12345-0@lo:104: 00010000:00010000:2.0:1787853077.742724:0:7630:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.101@tcp lock: ffff8f492a8ac000/0x710df789068e6263 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x710df789068e626a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853077.742768:0:7630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1787853077.742786:0:7630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493c5a6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:5d48a955-7010-4118-9c7d-f396984ae1ff+3:11671:x1874699552353408:12345-0@lo:104: Request processed in 56us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853077.742793:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787853077.742989:0:11671:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4910d12580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11671:1874699552353152:0@lo:104: 00000100:00100000:0.0:1787853077.743000:0:11671:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4910d112c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11671:1874699552353280:0@lo:104: 00000100:00100000:0.0:1787853077.743006:0:11671:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4910d11e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11671:1874699552353408:0@lo:104: 00010000:00010000:2.0:1787853077.743228:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787853077.743235:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.101@tcp lock: ffff8f4900031a00/0x710df789068e627f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x710df789068e6286 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853077.743243:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4900031a00 already unused, calling callback (ffffffffc1b55c20) 10000000:00010000:2.0:1787853077.743247:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.101@tcp lock: ffff8f4900031a00/0x710df789068e627f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x710df789068e6286 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853077.743268:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.101@tcp lock: ffff8f4900031a00/0x710df789068e627f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x710df789068e6286 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787853077.743276:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.101@tcp lock: ffff8f4900031a00/0x710df789068e627f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x710df789068e6286 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787853077.743283:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787853077.743318:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.101@tcp lock: ffff8f4900031a00/0x710df789068e627f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x710df789068e6286 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853077.743325:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787853077.743346:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.101@tcp lock: ffff8f4900031a00/0x710df789068e627f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x710df789068e6286 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853077.743354:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.101@tcp lock: ffff8f4900031a00/0x710df789068e627f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x710df789068e6286 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853077.743389:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787853077.743393:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.101@tcp lock: ffff8f4900030200/0x710df789068e6271 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x710df789068e6278 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853077.743400:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4900030200 already unused, calling callback (ffffffffc1b55c20) 10000000:00010000:2.0:1787853077.743403:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.101@tcp lock: ffff8f4900030200/0x710df789068e6271 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x710df789068e6278 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853077.743411:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.101@tcp lock: ffff8f4900030200/0x710df789068e6271 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x710df789068e6278 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787853077.743418:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.101@tcp lock: ffff8f4900030200/0x710df789068e6271 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x710df789068e6278 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787853077.743423:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787853077.743436:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.101@tcp lock: ffff8f4900030200/0x710df789068e6271 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x710df789068e6278 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853077.743441:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787853077.743455:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.101@tcp lock: ffff8f4900030200/0x710df789068e6271 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x710df789068e6278 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853077.743462:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.101@tcp lock: ffff8f4900030200/0x710df789068e6271 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x710df789068e6278 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853077.743471:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787853077.743474:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.101@tcp lock: ffff8f492a8ac000/0x710df789068e6263 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x710df789068e626a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853077.743492:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f492a8ac000 already unused, calling callback (ffffffffc1b55c20) 10000000:00010000:2.0:1787853077.743495:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.101@tcp lock: ffff8f492a8ac000/0x710df789068e6263 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x710df789068e626a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853077.743503:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.101@tcp lock: ffff8f492a8ac000/0x710df789068e6263 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x710df789068e626a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787853077.743510:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.101@tcp lock: ffff8f492a8ac000/0x710df789068e6263 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x710df789068e626a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787853077.743515:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787853077.743539:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.101@tcp lock: ffff8f492a8ac000/0x710df789068e6263 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x710df789068e626a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853077.743545:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787853077.743551:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.101@tcp lock: ffff8f492a8ac000/0x710df789068e6263 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x710df789068e626a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853077.743557:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.101@tcp lock: ffff8f492a8ac000/0x710df789068e6263 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x710df789068e626a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853077.743590:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853077.743592:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853077.743594:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853077.743600:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787853077.743612:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49031c2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5d48a955-7010-4118-9c7d-f396984ae1ff:3309:1874699552353536:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787853077.743649:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853077.743689:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4941af3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5d48a955-7010-4118-9c7d-f396984ae1ff:3307:1874699552353792:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787853077.743721:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853077.743738:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787853077.743744:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49031c1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5d48a955-7010-4118-9c7d-f396984ae1ff:3307:1874699552353664:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787853077.743763:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853077.744073:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552353536 00000100:00100000:2.0:1787853077.744078:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552353536 00010000:00010000:2.0:1787853077.744104:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f49415b9200/0x710df789068e6286 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x710df789068e627f expref: 19 pid: 5830 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853077.744166:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552353792 00000100:00100000:2.0:1787853077.744169:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552353792 00010000:00010000:2.0:1787853077.744180:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f4900030400/0x710df789068e626a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x710df789068e6263 expref: 20 pid: 5831 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853077.744255:0:5821:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/1 left), rc = 0 00010000:00010000:3.0:1787853077.744280:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787853077.744330:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552353664 00000100:00100000:1.0:1787853077.744334:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552353664 00010000:00010000:1.0:1787853077.744350:0:8450:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f492a8ac800/0x710df789068e6278 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x710df789068e6271 expref: 21 pid: 5830 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853077.744384:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787853077.744391:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4941af0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5d48a955-7010-4118-9c7d-f396984ae1ff+21:3309:x1874699552353536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787853077.744402:0:8450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787853077.744407:0:8450:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f49415b9200/0x710df789068e6286 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x710df789068e627f expref: 21 pid: 5830 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853077.744417:0:8450:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f49415b9200/0x710df789068e6286 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x710df789068e627f expref: 21 pid: 5830 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853077.744444:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f49415b9200/0x710df789068e6286 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x710df789068e627f expref: 21 pid: 5830 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853077.744458:0:8450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787853077.744494:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4941af0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5d48a955-7010-4118-9c7d-f396984ae1ff+20:3309:x1874699552353536:12345-0@lo:103:ldlm_bl.0 Request processed in 104us (845us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853077.744503:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787853077.744520:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787853077.744527:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4941af12c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5d48a955-7010-4118-9c7d-f396984ae1ff+19:3307:x1874699552353792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787853077.744535:0:8450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787853077.744540:0:8450:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f4900030400/0x710df789068e626a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x710df789068e6263 expref: 19 pid: 5831 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853077.744548:0:8450:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f4900030400/0x710df789068e626a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x710df789068e6263 expref: 19 pid: 5831 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853077.744558:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f4900030400/0x710df789068e626a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x710df789068e6263 expref: 19 pid: 5831 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853077.744587:0:8450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787853077.744613:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4941af12c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5d48a955-7010-4118-9c7d-f396984ae1ff+18:3307:x1874699552353792:12345-0@lo:103:ldlm_bl.0 Request processed in 86us (891us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853077.744619:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787853077.744631:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787853077.744636:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4941af0f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5d48a955-7010-4118-9c7d-f396984ae1ff+17:3307:x1874699552353664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787853077.744643:0:8450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787853077.744647:0:8450:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f492a8ac800/0x710df789068e6278 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x710df789068e6271 expref: 17 pid: 5830 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853077.744661:0:8450:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f492a8ac800/0x710df789068e6278 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x710df789068e6271 expref: 17 pid: 5830 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853077.744671:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f492a8ac800/0x710df789068e6278 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x710df789068e6271 expref: 17 pid: 5830 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853077.744679:0:8450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787853077.744699:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4941af0f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5d48a955-7010-4118-9c7d-f396984ae1ff+16:3307:x1874699552353664:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (935us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853077.744706:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787853077.744994:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49031c2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5d48a955-7010-4118-9c7d-f396984ae1ff:3309:1874699552353536:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787853077.745021:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49031c1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5d48a955-7010-4118-9c7d-f396984ae1ff:3307:1874699552353664:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787853077.745029:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4941af3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5d48a955-7010-4118-9c7d-f396984ae1ff:3307:1874699552353792:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787853077.750638:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853077.750672:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853077.750790:0:11671:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4910d121c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11671:1874699552352896:192.168.204.1@tcp:104: 00000100:00100000:0.0:1787853077.750803:0:11671:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4910d10f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11671:1874699552353024:192.168.204.1@tcp:104: 00010000:00010000:0.0:1787853077.750835:0:11671:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f49415b6a00/0x710df789068e63c8 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853077.750913:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526100864 00000100:00100000:1.0:1787853077.750920:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526100864 00010000:00010000:1.0:1787853077.750955:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f492a8ace00/0x710df789068e6294 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793895ee expref: 13 pid: 5829 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853077.750989:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526100992 00000100:00100000:1.0:1787853077.750993:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526100992 00010000:00010000:1.0:1787853077.751005:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f492a8ac600/0x710df789068e628d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793895e7 expref: 14 pid: 5831 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853077.751030:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 33 00000100:00100000:0.0:1787853077.751183:0:11175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 34 00000100:00100000:0.0:1787853077.751192:0:11175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4941af3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:af755b38-4932-400a-92cc-ddad0ca077a5+14:2363:x1874699526100992:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787853077.751208:0:11175:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787853077.751215:0:11175:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f492a8ac600/0x710df789068e628d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793895e7 expref: 14 pid: 5831 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853077.751242:0:11175:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f492a8ac600/0x710df789068e628d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793895e7 expref: 14 pid: 5831 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853077.751262:0:11175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f492a8ac600/0x710df789068e628d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793895e7 expref: 14 pid: 5831 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853077.751279:0:11175:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787853077.751336:0:11175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4941af3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:af755b38-4932-400a-92cc-ddad0ca077a5+13:2363:x1874699526100992:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 145us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853077.751344:0:11175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 34 00000100:00100000:1.0:1787853077.751390:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f491e972850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:af755b38-4932-400a-92cc-ddad0ca077a5+12:2363:x1874699526100864:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787853077.751413:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787853077.751419:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f492a8ace00/0x710df789068e6294 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793895ee expref: 12 pid: 5829 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853077.751429:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f492a8ace00/0x710df789068e6294 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793895ee expref: 12 pid: 5829 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853077.751451:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f492a8ace00/0x710df789068e6294 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793895ee expref: 12 pid: 5829 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853077.751462:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f49415b6a00/0x710df789068e63c8 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853077.751471:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f49415b6a00/0x710df789068e63c8 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853077.751487:0:5824:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f49415b6a00/0x710df789068e63c8 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853077.751494:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f49415b6a00/0x710df789068e63c8 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853077.751501:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f49415b6a00/0x710df789068e63c8 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853077.751508:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f49415b6a00/0x710df789068e63c8 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853077.751515:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b6a00 already unused, calling callback (ffffffffc1528440) 00010000:00010000:1.0:1787853077.751519:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f49415b6a00/0x710df789068e63c8 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853077.751527:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f49415b6a00/0x710df789068e63c8 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853077.751548:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f49415b6a00/0x710df789068e63c8 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853077.751593:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787853077.751616:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f491e972850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:af755b38-4932-400a-92cc-ddad0ca077a5+11:2363:x1874699526100864:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 576us (987us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853077.751623:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 33 00010000:00010000:0.0:1787853077.751820:0:11671:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f49415b6a00/0x710df789068e63c8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853077.751828:0:11671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f49415b6a00/0x710df789068e63c8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853077.751834:0:11671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f49415b6a00/0x710df789068e63c8 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853077.825248:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853077.825293:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853077.825332:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853077.825361:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526101120 00000100:00100000:1.0:1787853077.825370:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526101120 00000100:00100000:1.0:1787853077.825439:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526101376 00000100:00100000:1.0:1787853077.825442:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526101376 00000100:00100000:1.0:1787853077.825466:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 120 00000100:00100000:1.0:1787853077.825476:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4934237840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+5:2362:x1874699526101120:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:1.0:1787853077.825548:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4934237840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+5:2362:x1874699526101120:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 74us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853077.825556:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 120 00000100:00100000:1.0:1787853077.825612:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 121 00000100:00100000:1.0:1787853077.825619:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49342343c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ea3b4e1-e827-460f-be07-19e86dff3d79+5:2362:x1874699526101376:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:1.0:1787853077.825643:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49342343c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ea3b4e1-e827-460f-be07-19e86dff3d79+5:2362:x1874699526101376:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 25us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853077.825649:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 121 00000100:00080000:1.0:1787853077.825664:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787853077.827316:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526101248 00000100:00100000:3.0:1787853077.827327:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526101248 00000100:00100000:3.0:1787853077.827415:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 69 00000100:00100000:3.0:1787853077.827425:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49342361c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+5:2362:x1874699526101248:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:3.0:1787853077.827513:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49342361c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+5:2362:x1874699526101248:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 91us (2277us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853077.827521:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 69 00000100:00080000:1.0:1787853077.828728:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787853078.313897:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787853079.209941:0:5834:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787853079.209951:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f493dc01800 from 7 10000000:01000000:3.0:1787853079.209956:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787853079.210018:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f4921e21600/0x710df789068e63cf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853079.210031:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.101@tcp lock: ffff8f4921e21600/0x710df789068e63cf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853079.210044:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: ffff8f4921e21600/0x710df789068e63cf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853079.210085:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49065d4780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552353920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787853079.210185:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853079.210257:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f493480d6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787853079.210386:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552353920 00000100:00100000:2.0:1787853079.210394:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552353920 00000100:00100000:2.0:1787853079.210453:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1787853079.210463:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4904f55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d48a955-7010-4118-9c7d-f396984ae1ff+16:5834:x1874699552353920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787853079.210480:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853079.210496:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f49415b9200/0x710df789068e63d6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x710df789068e63cf expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853079.210758:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f49415b9200/0x710df789068e63d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x710df789068e63cf expref: 17 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853079.210770:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f49415b9200/0x710df789068e63d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x710df789068e63cf expref: 17 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853079.210934:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49415b9200, rc 0) 00000100:00100000:2.0:1787853079.210996:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4904f55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d48a955-7010-4118-9c7d-f396984ae1ff+17:5834:x1874699552353920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 534us (812us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853079.211004:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1787853079.214721:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49065d4780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552353920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787853079.214766:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: ffff8f4921e21600/0x710df789068e63cf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e63d6 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853079.214786:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: ffff8f4921e21600/0x710df789068e63cf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x710df789068e63d6 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853079.214884:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49065d4780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552354048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787853079.214953:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853079.215006:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f493480d6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787853079.215264:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552354048 00000100:00100000:1.0:1787853079.215271:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552354048 00000100:00100000:1.0:1787853079.215336:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1787853079.215353:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4904f57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+17:5834:x1874699552354048:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787853079.215669:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4904f57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+17:5834:x1874699552354048:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 317us (714us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853079.215677:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1787853079.216183:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49065d4780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552354048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787853079.216222:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49065d4780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552354176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787853079.216264:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853079.216303:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f493480d6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787853079.216455:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552354176 00000100:00100000:2.0:1787853079.216460:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552354176 00000100:00100000:2.0:1787853079.216512:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1787853079.216520:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4904f56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d48a955-7010-4118-9c7d-f396984ae1ff+17:5834:x1874699552354176:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787853079.217038:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4904f56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d48a955-7010-4118-9c7d-f396984ae1ff+17:5834:x1874699552354176:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 517us (772us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853079.217046:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1787853079.217127:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49065d4780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552354176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787853079.219786:0:11685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49065d4780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d48a955-7010-4118-9c7d-f396984ae1ff:11685:1874699552354304:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787853079.220038:0:11685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853079.220099:0:11685:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f493480d180 going to sleep for 11 seconds 00000100:00100000:2.0:1787853079.221352:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552354304 00000100:00100000:2.0:1787853079.221362:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552354304 00000100:00100000:2.0:1787853079.221427:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1787853079.221439:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4904f51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+17:11685:x1874699552354304:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787853079.222145:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4904f51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+17:11685:x1874699552354304:12345-0@lo:502:llog_process_th.0 Request processed in 335us (1734us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853079.222155:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1787853079.224207:0:11685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49065d4780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d48a955-7010-4118-9c7d-f396984ae1ff:11685:1874699552354304:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787853079.224261:0:11685:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787853079.224277:0:11685:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787853079.224279:0:11685:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787853079.224297:0:11685:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8f493dc01800 00000020:00000080:3.0:1787853079.224301:0:11685:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787853079.224411:0:11685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49065d4780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d48a955-7010-4118-9c7d-f396984ae1ff:11685:1874699552354432:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787853079.224492:0:11685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853079.224536:0:11685:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f493480d180 going to sleep for 11 seconds 00000100:00100000:1.0:1787853079.225275:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552354432 00000100:00100000:1.0:1787853079.225286:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552354432 00000100:00100000:1.0:1787853079.225357:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1787853079.225369:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4904f52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+17:11685:x1874699552354432:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787853079.227287:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4904f52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+17:11685:x1874699552354432:12345-0@lo:502:llog_process_th.0 Request processed in 1915us (2790us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853079.228535:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1787853079.228715:0:11685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49065d4780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d48a955-7010-4118-9c7d-f396984ae1ff:11685:1874699552354432:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787853079.228771:0:11685:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787853079.228788:0:11685:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787853079.228790:0:11685:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1787853079.228795:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1787853079.234951:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1787853079.234992:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787853079.235004:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f4921e21600/0x710df789068e63cf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e63d6 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853079.235019:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: ffff8f4921e21600/0x710df789068e63cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e63d6 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787853079.235032:0:5834:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787853079.235035:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f4903010800 from 7 10000000:01000000:1.0:1787853079.235038:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787853079.235084:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f492a8ace00/0x710df789068e63dd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853079.235093:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.101@tcp lock: ffff8f492a8ace00/0x710df789068e63dd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853079.235104:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: ffff8f492a8ace00/0x710df789068e63dd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853079.235148:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49342370c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552354560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787853079.235217:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853079.235270:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f4910dbb540 going to sleep for 11 seconds 00000100:00100000:1.0:1787853079.235325:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552354560 00000100:00100000:1.0:1787853079.235332:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552354560 00000100:00100000:1.0:1787853079.235378:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1787853079.235386:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4904f53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+17:5834:x1874699552354560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787853079.235399:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853079.235412:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f492a8ac200/0x710df789068e63e4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x710df789068e63dd expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853079.235434:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f492a8ac200/0x710df789068e63e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x710df789068e63dd expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853079.235444:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f492a8ac200/0x710df789068e63e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x710df789068e63dd expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853079.235453:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f492a8ac200, rc 0) 00000100:00100000:1.0:1787853079.235489:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4904f53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+18:5834:x1874699552354560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853079.235496:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1787853079.235542:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49342370c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552354560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787853079.235557:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: ffff8f492a8ace00/0x710df789068e63dd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e63e4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853079.235600:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: ffff8f492a8ace00/0x710df789068e63dd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x710df789068e63e4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853079.235667:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49342370c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552354688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787853079.235695:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853079.235710:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f4910dbb540 going to sleep for 11 seconds 00000100:00100000:1.0:1787853079.235723:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552354688 00000100:00100000:1.0:1787853079.235726:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552354688 00000100:00100000:1.0:1787853079.235758:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1787853079.235764:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4904f53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d48a955-7010-4118-9c7d-f396984ae1ff+18:5834:x1874699552354688:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787853079.236037:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4904f53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d48a955-7010-4118-9c7d-f396984ae1ff+18:5834:x1874699552354688:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 273us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853079.236045:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1787853079.236073:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49342370c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552354688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787853079.236100:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49342370c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552354816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787853079.236137:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853079.236150:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f4910dbb540 going to sleep for 11 seconds 00000100:00100000:1.0:1787853079.236161:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552354816 00000100:00100000:1.0:1787853079.236163:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552354816 00000100:00100000:1.0:1787853079.236181:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1787853079.236187:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4904f52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+18:5834:x1874699552354816:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787853079.236325:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4904f52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+18:5834:x1874699552354816:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 137us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853079.236331:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1787853079.236366:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49342370c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552354816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787853079.236546:0:11687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49342370c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d48a955-7010-4118-9c7d-f396984ae1ff:11687:1874699552354944:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787853079.236607:0:11687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853079.236625:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552354944 00000100:00100000:1.0:1787853079.236629:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552354944 00000100:00100000:1.0:1787853079.236649:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1787853079.236655:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4904f52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+18:11687:x1874699552354944:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787853079.236794:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4904f52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+18:11687:x1874699552354944:12345-0@lo:502:llog_process_th.0 Request processed in 138us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853079.236801:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1787853079.236829:0:11687:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f4902af1000 going to sleep for 11 seconds 00000100:00100000:1.0:1787853079.236840:0:11687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49342370c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d48a955-7010-4118-9c7d-f396984ae1ff:11687:1874699552354944:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787853079.236858:0:11687:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787853079.236866:0:11687:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787853079.236869:0:11687:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787853079.236875:0:11687:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8f4903010800 00000020:00000080:1.0:1787853079.236878:0:11687:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787853079.236946:0:11687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49342370c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d48a955-7010-4118-9c7d-f396984ae1ff:11687:1874699552355072:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787853079.236978:0:11687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853079.236997:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552355072 00000100:00100000:1.0:1787853079.237000:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552355072 00000100:00100000:1.0:1787853079.237020:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1787853079.237027:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4904f51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d48a955-7010-4118-9c7d-f396984ae1ff+18:11687:x1874699552355072:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787853079.237126:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4904f51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d48a955-7010-4118-9c7d-f396984ae1ff+18:11687:x1874699552355072:12345-0@lo:502:llog_process_th.0 Request processed in 99us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853079.237133:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1787853079.237159:0:11687:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f4902af1000 going to sleep for 11 seconds 00000100:00100000:1.0:1787853079.237169:0:11687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49342370c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d48a955-7010-4118-9c7d-f396984ae1ff:11687:1874699552355072:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787853079.237191:0:11687:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787853079.237195:0:11687:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787853079.237197:0:11687:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1787853079.237201:0:11687:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1787853079.237259:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1787853079.237275:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787853079.237283:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f492a8ace00/0x710df789068e63dd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e63e4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853079.237294:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: ffff8f492a8ace00/0x710df789068e63dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e63e4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787853079.237305:0:5834:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787853079.237308:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f492abd6000 from 7 10000000:01000000:1.0:1787853079.237311:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787853079.237332:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f492a8ac800/0x710df789068e63eb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853079.237340:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.101@tcp lock: ffff8f492a8ac800/0x710df789068e63eb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853079.237348:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: ffff8f492a8ac800/0x710df789068e63eb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853079.237360:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49342370c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552355200:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787853079.237387:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853079.237399:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f4902af1000 going to sleep for 11 seconds 00000100:00100000:1.0:1787853079.237409:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552355200 00000100:00100000:1.0:1787853079.237412:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552355200 00000100:00100000:1.0:1787853079.237429:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1787853079.237440:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4904f50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+18:5834:x1874699552355200:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787853079.237447:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853079.237458:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f492a8ac600/0x710df789068e63f2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x710df789068e63eb expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853079.237476:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f492a8ac600/0x710df789068e63f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x710df789068e63eb expref: 19 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853079.237485:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f492a8ac600/0x710df789068e63f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x710df789068e63eb expref: 19 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853079.237493:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f492a8ac600, rc 0) 00000100:00100000:1.0:1787853079.237520:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4904f50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+19:5834:x1874699552355200:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 80us (132us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853079.237525:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1787853079.237550:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49342370c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552355200:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787853079.237561:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: ffff8f492a8ac800/0x710df789068e63eb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e63f2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853079.237592:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: ffff8f492a8ac800/0x710df789068e63eb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x710df789068e63f2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853079.237631:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49342370c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552355328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787853079.237655:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853079.237669:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f4902af1000 going to sleep for 11 seconds 00000100:00100000:1.0:1787853079.237681:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552355328 00000100:00100000:1.0:1787853079.237684:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552355328 00000100:00100000:1.0:1787853079.237702:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1787853079.237714:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4904f50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+19:5834:x1874699552355328:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787853079.252169:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4904f50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+19:5834:x1874699552355328:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 14446us (14504us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853079.252183:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1787853079.252410:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49342370c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552355328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787853079.252476:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4910d10f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552355456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787853079.255947:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853079.256013:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f49012ed000 going to sleep for 11 seconds 00000100:00100000:1.0:1787853079.271967:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552355456 00000100:00100000:1.0:1787853079.271985:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552355456 00000100:00100000:1.0:1787853079.272115:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1787853079.272127:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4904f50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d48a955-7010-4118-9c7d-f396984ae1ff+19:5834:x1874699552355456:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787853079.272451:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4904f50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d48a955-7010-4118-9c7d-f396984ae1ff+19:5834:x1874699552355456:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 325us (16511us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853079.272459:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1787853079.272615:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4910d10f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d48a955-7010-4118-9c7d-f396984ae1ff:5834:1874699552355456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787853079.272953:0:11689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4910d10f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d48a955-7010-4118-9c7d-f396984ae1ff:11689:1874699552355584:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787853079.273005:0:11689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853079.287005:0:11689:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f49012ed000 going to sleep for 11 seconds 00000100:00100000:3.0:1787853079.289074:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552355584 00000100:00100000:3.0:1787853079.289089:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552355584 00000100:00100000:3.0:1787853079.289153:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1787853079.289163:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4904f53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+19:11689:x1874699552355584:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787853079.289507:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4904f53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+19:11689:x1874699552355584:12345-0@lo:502:llog_process_th.0 Request processed in 345us (16502us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853079.289514:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1787853079.289785:0:11689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4910d10f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d48a955-7010-4118-9c7d-f396984ae1ff:11689:1874699552355584:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787853079.289825:0:11689:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787853079.289836:0:11689:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787853079.289839:0:11689:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787853079.289847:0:11689:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8f492abd6000 00000020:00000080:0.0:1787853079.289850:0:11689:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787853079.289963:0:11689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4910d10f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d48a955-7010-4118-9c7d-f396984ae1ff:11689:1874699552355712:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787853079.290007:0:11689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853079.290037:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552355712 00000100:00100000:0.0:1787853079.290041:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552355712 00000100:00100000:0.0:1787853079.290064:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1787853079.290070:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4904f50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+19:11689:x1874699552355712:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787853079.290184:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4904f50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+19:11689:x1874699552355712:12345-0@lo:502:llog_process_th.0 Request processed in 113us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853079.290191:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1787853079.290232:0:11689:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f493c4fea80 going to sleep for 11 seconds 00000100:00100000:0.0:1787853079.290244:0:11689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4910d10f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d48a955-7010-4118-9c7d-f396984ae1ff:11689:1874699552355712:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787853079.290262:0:11689:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787853079.290267:0:11689:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787853079.290268:0:11689:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1787853079.290272:0:11689:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1787853079.290339:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1787853079.290365:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787853079.290376:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f492a8ac800/0x710df789068e63eb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e63f2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853079.290388:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: ffff8f492a8ac800/0x710df789068e63eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e63f2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787853079.293761:0:11690:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787853079.346232:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787853079.488907:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853079.489052:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526101504 00000100:00100000:0.0:1787853079.489061:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526101504 00000100:00100000:0.0:1787853079.489128:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 273 00000100:00100000:0.0:1787853079.489138:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4904f53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af755b38-4932-400a-92cc-ddad0ca077a5+11:5609:x1874699526101504:12345-192.168.204.1@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787853079.489155:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853079.489173:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f49415b6c00/0x710df789068e63f9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd0a9c507938963b expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853079.489201:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f49415b6c00/0x710df789068e63f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c507938963b expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853079.489212:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f49415b6c00/0x710df789068e63f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c507938963b expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853079.489221:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49415b6c00, rc 0) 00000100:00100000:0.0:1787853079.489278:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4904f53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af755b38-4932-400a-92cc-ddad0ca077a5+12:5609:x1874699526101504:12345-192.168.204.1@tcp:101:ll_cfg_requeue.0 Request processed in 141us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853079.489285:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 273 00000100:00100000:3.0:1787853079.498322:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853079.498426:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526101632 00000100:00100000:2.0:1787853079.498452:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526101632 00000100:00100000:2.0:1787853079.498714:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 274 00000100:00100000:3.0:1787853079.517926:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4904f51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af755b38-4932-400a-92cc-ddad0ca077a5+12:5609:x1874699526101632:12345-192.168.204.1@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787853079.518715:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4904f51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af755b38-4932-400a-92cc-ddad0ca077a5+12:5609:x1874699526101632:12345-192.168.204.1@tcp:501:ll_cfg_requeue.0 Request processed in 19991us (20400us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853079.518726:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 274 00000100:00100000:2.0:1787853079.531904:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853079.547729:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526101760 00000100:00100000:1.0:1787853079.547759:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526101760 00000100:00100000:1.0:1787853079.547838:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 275 00000100:00100000:1.0:1787853079.547848:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4904f52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af755b38-4932-400a-92cc-ddad0ca077a5+12:5609:x1874699526101760:12345-192.168.204.1@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787853079.548086:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4904f52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af755b38-4932-400a-92cc-ddad0ca077a5+12:5609:x1874699526101760:12345-192.168.204.1@tcp:503:ll_cfg_requeue.0 Request processed in 239us (16191us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853079.548094:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 275 00000100:00100000:1.0:1787853079.556987:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853079.557552:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526101888 00000100:00100000:3.0:1787853079.557562:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526101888 00000100:00100000:3.0:1787853079.557666:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 276 00000100:00100000:3.0:1787853079.557676:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4904f51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af755b38-4932-400a-92cc-ddad0ca077a5+12:9984:x1874699526101888:12345-192.168.204.1@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787853079.558312:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4904f51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af755b38-4932-400a-92cc-ddad0ca077a5+12:9984:x1874699526101888:12345-192.168.204.1@tcp:502:llog_process_th.0 Request processed in 635us (1333us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853079.558320:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 276 00000100:00100000:3.0:1787853079.566203:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853079.566310:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526102016 00000100:00100000:0.0:1787853079.566320:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526102016 00000100:00100000:0.0:1787853079.566386:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 277 00000100:00100000:0.0:1787853079.566396:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4911c01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af755b38-4932-400a-92cc-ddad0ca077a5+12:9984:x1874699526102016:12345-192.168.204.1@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787853079.567146:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4911c01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af755b38-4932-400a-92cc-ddad0ca077a5+12:9984:x1874699526102016:12345-192.168.204.1@tcp:502:llog_process_th.0 Request processed in 750us (953us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853079.567155:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 277 00000100:00100000:0.0:1787853079.580476:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853079.582297:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526102144 00000100:00100000:2.0:1787853079.582309:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526102144 00000100:00100000:2.0:1787853079.582387:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 278 00000100:00100000:2.0:1787853079.582408:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4911c02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af755b38-4932-400a-92cc-ddad0ca077a5+12:5609:x1874699526102144:12345-192.168.204.1@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787853079.582426:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853079.582445:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f49415b9400/0x710df789068e6400 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd0a9c5079389642 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853079.582485:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f49415b9400/0x710df789068e6400 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389642 expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853079.583392:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f49415b9400/0x710df789068e6400 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389642 expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853079.583403:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49415b9400, rc 0) 00000100:00100000:2.0:1787853079.587226:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4911c02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af755b38-4932-400a-92cc-ddad0ca077a5+13:5609:x1874699526102144:12345-192.168.204.1@tcp:101:ll_cfg_requeue.0 Request processed in 1073us (3011us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853079.587243:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 278 00000100:00100000:3.0:1787853079.587648:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853079.588042:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526102272 00000100:00100000:0.0:1787853079.588052:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526102272 00000100:00100000:0.0:1787853079.588108:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 279 00000100:00100000:0.0:1787853079.588118:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4911c01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af755b38-4932-400a-92cc-ddad0ca077a5+13:5609:x1874699526102272:12345-192.168.204.1@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787853079.588421:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4911c01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af755b38-4932-400a-92cc-ddad0ca077a5+13:5609:x1874699526102272:12345-192.168.204.1@tcp:501:ll_cfg_requeue.0 Request processed in 303us (773us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853079.588429:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 279 00000100:00100000:3.0:1787853079.597639:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853079.601484:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526102400 00000100:00100000:1.0:1787853079.601498:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526102400 00000100:00100000:1.0:1787853079.601613:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 280 00000100:00100000:1.0:1787853079.601623:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4911c03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af755b38-4932-400a-92cc-ddad0ca077a5+13:5609:x1874699526102400:12345-192.168.204.1@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787853079.601867:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4911c03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af755b38-4932-400a-92cc-ddad0ca077a5+13:5609:x1874699526102400:12345-192.168.204.1@tcp:503:ll_cfg_requeue.0 Request processed in 244us (4236us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853079.601883:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 280 00000100:00100000:3.0:1787853079.612990:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853079.613373:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526102528 00000100:00100000:2.0:1787853079.613382:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526102528 00000100:00100000:2.0:1787853079.613440:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 281 00000100:00100000:2.0:1787853079.613449:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4911c00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af755b38-4932-400a-92cc-ddad0ca077a5+13:9987:x1874699526102528:12345-192.168.204.1@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787853079.613766:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4911c00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af755b38-4932-400a-92cc-ddad0ca077a5+13:9987:x1874699526102528:12345-192.168.204.1@tcp:502:llog_process_th.0 Request processed in 316us (785us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853079.613774:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 281 00000100:00100000:3.0:1787853079.627340:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853079.627503:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526102656 00000100:00100000:2.0:1787853079.627512:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526102656 00000100:00100000:2.0:1787853079.627614:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 282 00000100:00100000:2.0:1787853079.627635:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4911c00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af755b38-4932-400a-92cc-ddad0ca077a5+13:9987:x1874699526102656:12345-192.168.204.1@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787853079.628177:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4911c00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af755b38-4932-400a-92cc-ddad0ca077a5+13:9987:x1874699526102656:12345-192.168.204.1@tcp:502:llog_process_th.0 Request processed in 553us (846us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853079.628186:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 282 00000100:00100000:3.0:1787853080.301001:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4941af1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5d48a955-7010-4118-9c7d-f396984ae1ff:3308:1874699552355840:0@lo:400:kworker.0 00000100:00100000:3.0:1787853080.301080:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853080.301223:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4941af21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1874699552356224:0@lo:400:kworker.0 00000100:00100000:2.0:1787853080.301256:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853080.301327:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787853080.301334:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4941af0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874699552356096:0@lo:400:kworker.0 00000100:00100000:2.0:1787853080.301362:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853080.301514:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4941af3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1874699552356352:0@lo:400:kworker.0 00000100:00100000:0.0:1787853080.301532:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4941af0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874699552355968:0@lo:400:kworker.0 00000100:00100000:3.0:1787853080.301539:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853080.301558:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853080.301597:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4941af03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874699552356480:0@lo:400:kworker.0 00000100:00100000:3.0:1787853080.301604:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552356224 00000100:00100000:3.0:1787853080.301610:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552356224 00000100:00100000:0.0:1787853080.301631:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853080.301657:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552356352 00000100:00100000:3.0:1787853080.301660:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552356352 00000100:00100000:3.0:1787853080.301702:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552355968 00000100:00100000:3.0:1787853080.301705:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552355968 00000100:00100000:3.0:1787853080.301975:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1787853080.301986:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4941af30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874699552356224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853080.302035:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4941af30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874699552356224:12345-0@lo:400:kworker.0 Request processed in 52us (779us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853080.302042:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1787853080.302059:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1787853080.302064:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49065d4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874699552356352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853080.302090:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49065d4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874699552356352:12345-0@lo:400:kworker.0 Request processed in 25us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853080.302095:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1787853080.302104:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1787853080.302110:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4910d10f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874699552355968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853080.302133:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4910d10f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874699552355968:12345-0@lo:400:kworker.0 Request processed in 24us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853080.302139:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1787853080.302170:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4941af3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1874699552356352:0@lo:400:kworker.0 00000040:00080000:0.0:1787853080.302193:0:11690:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787853080.302207:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4941af21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1874699552356224:0@lo:400:kworker.0 00000100:00080000:3.0:1787853080.302227:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787853080.302245:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552356096 00000100:00100000:3.0:1787853080.302248:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552356096 00000100:00100000:0.0:1787853080.302261:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4941af0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874699552355968:0@lo:400:kworker.0 00000100:00100000:3.0:1787853080.302275:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552356480 00000100:00100000:3.0:1787853080.302278:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552356480 00000100:00100000:0.0:1787853080.302286:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787853080.302293:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4941af1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3307:x1874699552356096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853080.302389:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787853080.302408:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4910d121c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1874699552356480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853080.302445:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4910d121c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1874699552356480:12345-0@lo:400:kworker.0 Request processed in 39us (813us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853080.302450:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:2.0:1787853080.302476:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787853080.302478:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787853080.302502:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4941af0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874699552356096:0@lo:400:kworker.0 00000100:00100000:0.0:1787853080.302649:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4941af1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3307:x1874699552356096:12345-0@lo:400:kworker.0 Request processed in 36us (965us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853080.302655:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00010000:00080000:0.0:1787853080.302883:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f4941af03c0 x1874699552356480/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787853096 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787853080.302895:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4941af03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874699552356480:0@lo:400:kworker.0 00000100:00100000:1.0:1787853080.306546:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552355840 00000100:00100000:1.0:1787853080.306566:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552355840 00000100:00100000:1.0:1787853080.306749:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1787853080.306761:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4911c03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+19:3308:x1874699552355840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853080.306870:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4911c03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+19:3308:x1874699552355840:12345-0@lo:400:kworker.0 Request processed in 112us (5789us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853080.306878:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1787853080.306969:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4941af1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5d48a955-7010-4118-9c7d-f396984ae1ff:3308:1874699552355840:0@lo:400:kworker.0 00010000:00010000:3.0:1787853080.362527:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787853080.810918:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787853080.814590:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4941af0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874699552356608:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787853080.815467:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853080.815658:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49065d52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874699552356736:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787853080.815694:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853080.817562:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552356608 00000100:00100000:0.0:1787853080.817596:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552356608 00000100:00100000:0.0:1787853080.817729:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552356736 00000100:00100000:0.0:1787853080.817747:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552356736 00000100:00100000:3.0:1787853080.817895:0:10348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787853080.817908:0:10348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4934235680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1874699552356608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787853080.817947:0:10348:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787853080.818928:0:10348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4934235680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1874699552356608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1021us (3460us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853080.818938:0:10348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787853080.818974:0:10348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787853080.818983:0:10348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4934236940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874699552356736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787853080.819025:0:10348:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787853080.819052:0:10348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4934236940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874699552356736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (3367us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853080.819058:0:10348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787853080.819161:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4941af0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874699552356608:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1787853080.819177:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f49065d52c0 x1874699552356736/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787853096 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787853080.819190:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49065d52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874699552356736:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787853081.386277:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787853082.014114:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00010000:00010000:0.0:1787853082.431272:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787853082.944082:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853082.944929:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853082.956466:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853082.956532:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853082.956554:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526103040 00000100:00100000:2.0:1787853082.956591:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526103040 00000100:00100000:2.0:1787853082.956661:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 72 00000100:00100000:2.0:1787853082.956683:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4941af2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+5:2363:x1874699526103040:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:2.0:1787853082.956752:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4941af2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+5:2363:x1874699526103040:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 83us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853082.956759:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 72 00000100:00080000:2.0:1787853082.956782:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787853082.958205:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526102784 00000100:00100000:3.0:1787853082.958215:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526102784 00000100:00100000:3.0:1787853082.958270:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 284 00000100:00100000:3.0:1787853082.958288:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4911c00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af755b38-4932-400a-92cc-ddad0ca077a5+13:2363:x1874699526102784:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:3.0:1787853082.958344:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4911c00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af755b38-4932-400a-92cc-ddad0ca077a5+13:2363:x1874699526102784:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 66us (1889us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853082.958351:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 284 00000100:00100000:1.0:1787853082.961380:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526102912 00000100:00100000:1.0:1787853082.961395:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526102912 00000100:00100000:1.0:1787853082.961480:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526103168 00000100:00100000:1.0:1787853082.961485:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526103168 00000100:00100000:1.0:1787853082.961514:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 125 00000100:00100000:1.0:1787853082.961524:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49065d52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+5:2363:x1874699526102912:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:1.0:1787853082.961623:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49065d52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+5:2363:x1874699526102912:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 100us (17551us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853082.961643:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 125 00000100:00100000:1.0:1787853082.961661:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 126 00000100:00100000:1.0:1787853082.961668:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49065d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ea3b4e1-e827-460f-be07-19e86dff3d79+5:2363:x1874699526103168:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:1.0:1787853082.961707:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49065d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ea3b4e1-e827-460f-be07-19e86dff3d79+5:2363:x1874699526103168:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 39us (16781us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853082.961713:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 126 00000100:00080000:2.0:1787853082.961810:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787853083.433824:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853084.457880:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787853085.417906:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4934237480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1874699552357248:0@lo:400:kworker.0 00000100:00100000:0.0:1787853085.417928:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4934236580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874699552356992:0@lo:400:kworker.0 00000100:00100000:2.0:1787853085.417983:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4934236d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552357120:0@lo:400:kworker.0 00000100:00100000:3.0:1787853085.418042:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4934235e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5d48a955-7010-4118-9c7d-f396984ae1ff:3308:1874699552356864:0@lo:400:kworker.0 00000100:00100000:0.0:1787853085.420803:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853085.421557:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4934234780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874699552357504:0@lo:400:kworker.0 00000100:00100000:0.0:1787853085.421655:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853085.421718:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552357504 00000100:00100000:0.0:1787853085.421725:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552357504 00000100:00100000:0.0:1787853085.421791:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787853085.421801:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4910d112c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1874699552357504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853085.421853:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4910d112c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1874699552357504:12345-0@lo:400:kworker.0 Request processed in 54us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853085.423133:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:0.0:1787853085.423241:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787853085.423281:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f4934234780 x1874699552357504/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787853101 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787853085.423297:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4934234780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874699552357504:0@lo:400:kworker.0 00000100:00100000:0.0:1787853085.423332:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552356992 00000100:00100000:0.0:1787853085.423337:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552356992 00000100:00100000:0.0:1787853085.427895:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1787853085.427921:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4910d11e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874699552356992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853085.428021:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4910d11e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874699552356992:12345-0@lo:400:kworker.0 Request processed in 113us (7225us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853085.428028:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1787853085.428520:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853085.428609:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552357120 00000100:00100000:2.0:1787853085.428617:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552357120 00000100:00100000:0.0:1787853085.428653:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4934236580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874699552356992:0@lo:400:kworker.0 00000100:00100000:2.0:1787853085.428668:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787853085.428676:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4941af1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874699552357120:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787853085.428677:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787853085.428715:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4941af1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874699552357120:12345-0@lo:400:kworker.0 Request processed in 41us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853085.428722:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787853085.428748:0:3306:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:2.0:1787853085.428753:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8f4934234000, transno 4294967300 00000100:00100000:2.0:1787853085.428765:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4934236d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552357120:0@lo:400:kworker.0 00000100:00100000:3.0:1787853085.431799:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853085.431992:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4934237c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1874699552357376:0@lo:400:kworker.0 00000100:00100000:3.0:1787853085.432050:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853085.433674:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552357376 00000100:00100000:2.0:1787853085.433686:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552357376 00000100:00100000:2.0:1787853085.433762:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1787853085.433775:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49065d5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874699552357376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853085.433884:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49065d5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874699552357376:12345-0@lo:400:kworker.0 Request processed in 112us (1833us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853085.433892:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1787853085.434988:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4934237c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1874699552357376:0@lo:400:kworker.0 00000100:00100000:0.0:1787853085.442915:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552356864 00000100:00100000:0.0:1787853085.442928:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552356864 00000100:00100000:0.0:1787853085.443012:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1787853085.443021:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4911c01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+19:3308:x1874699552356864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853085.443128:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4911c01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+19:3308:x1874699552356864:12345-0@lo:400:kworker.0 Request processed in 108us (11338us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853085.443136:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00080000:0.0:1787853085.443199:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787853085.444351:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4934235e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5d48a955-7010-4118-9c7d-f396984ae1ff:3308:1874699552356864:0@lo:400:kworker.0 00000100:00100000:1.0:1787853085.449765:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853085.449831:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552357248 00000100:00100000:0.0:1787853085.449842:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552357248 00000100:00080000:2.0:1787853085.449992:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787853085.450148:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1787853085.450158:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49342352c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874699552357248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853085.450252:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49342352c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874699552357248:12345-0@lo:400:kworker.0 Request processed in 96us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853085.450259:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1787853085.450338:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4934237480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1874699552357248:0@lo:400:kworker.0 00010000:00010000:0.0:1787853085.482938:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787853085.933892:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4941af2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874699552357760:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787853085.933973:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853085.934017:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552357760 00000100:00100000:1.0:1787853085.934025:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552357760 00000100:00100000:1.0:1787853085.934088:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787853085.934098:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4934237480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874699552357760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787853085.934861:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787853085.934935:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4934237480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874699552357760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 836us (960us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853085.934944:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787853085.935022:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4941af2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874699552357760:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787853085.935044:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787853085.935292:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49065d70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874699552357632:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787853085.935328:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853085.935408:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552357632 00000100:00100000:1.0:1787853085.935413:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552357632 00000100:00100000:1.0:1787853085.935446:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787853085.935454:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4934234f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874699552357632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787853085.937460:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787853085.937660:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4934234f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874699552357632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2204us (2328us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853085.937670:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:3.0:1787853085.938686:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f49065d70c0 x1874699552357632/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787853101 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787853085.938710:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49065d70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874699552357632:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787853086.506482:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853087.530305:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787853088.064103:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853088.064152:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853088.064405:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526103552 00000100:00100000:1.0:1787853088.064415:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526103552 00000100:00100000:1.0:1787853088.064483:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 75 00000100:00100000:1.0:1787853088.064495:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49065d70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+5:2362:x1874699526103552:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:1.0:1787853088.064620:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49065d70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+5:2362:x1874699526103552:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 127us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853088.064627:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 75 00000100:00080000:0.0:1787853088.065266:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787853088.065395:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526103296 00000100:00100000:2.0:1787853088.065400:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526103296 00000100:00100000:2.0:1787853088.065441:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 286 00000100:00100000:2.0:1787853088.065449:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4911c02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af755b38-4932-400a-92cc-ddad0ca077a5+13:2362:x1874699526103296:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:2.0:1787853088.065496:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4911c02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af755b38-4932-400a-92cc-ddad0ca077a5+13:2362:x1874699526103296:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 48us (1403us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853088.065503:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 286 00000100:00100000:1.0:1787853088.067104:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853088.067142:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853088.067218:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526103424 00000100:00100000:0.0:1787853088.067226:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526103424 00000100:00100000:0.0:1787853088.067286:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526103680 00000100:00100000:0.0:1787853088.067290:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526103680 00000100:00100000:0.0:1787853088.067315:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 130 00000100:00100000:0.0:1787853088.067323:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4934235e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+5:2362:x1874699526103424:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:0.0:1787853088.067379:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4934235e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+5:2362:x1874699526103424:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 57us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853088.067386:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 130 00000100:00100000:0.0:1787853088.067401:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 131 00000100:00100000:0.0:1787853088.067408:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4934237c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ea3b4e1-e827-460f-be07-19e86dff3d79+5:2362:x1874699526103680:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:0.0:1787853088.067449:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4934237c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ea3b4e1-e827-460f-be07-19e86dff3d79+5:2362:x1874699526103680:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 42us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853088.067456:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 131 00000100:00080000:1.0:1787853088.068403:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787853088.555009:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787853089.578668:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787853090.538608:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4934234780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552358144:0@lo:400:kworker.0 00000040:00080000:0.0:1787853090.538658:0:11690:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787853090.538684:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853090.538717:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4934236580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874699552358016:0@lo:400:kworker.0 00000100:00100000:1.0:1787853090.538738:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787853090.538744:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49342370c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1874699552358272:0@lo:400:kworker.0 00000100:00100000:0.0:1787853090.538747:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853090.538766:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853090.538767:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4934234000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874699552358528:0@lo:400:kworker.0 00000100:00100000:0.0:1787853090.538785:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853090.538804:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552358144 00000100:00100000:1.0:1787853090.538810:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552358144 00000100:00100000:0.0:1787853090.538820:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787853090.538825:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4934236d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5d48a955-7010-4118-9c7d-f396984ae1ff:3309:1874699552357888:0@lo:400:kworker.0 00000100:00100000:0.0:1787853090.538849:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853090.538856:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552358528 00000100:00100000:1.0:1787853090.538859:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552358528 00000100:00100000:0.0:1787853090.538869:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4934235a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1874699552358400:0@lo:400:kworker.0 00000100:00100000:0.0:1787853090.538887:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853090.538911:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552358016 00000100:00100000:0.0:1787853090.538915:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552358016 00000100:00100000:0.0:1787853090.538954:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552358272 00000100:00100000:0.0:1787853090.538958:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552358272 00000100:00100000:0.0:1787853090.538969:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552358400 00000100:00100000:0.0:1787853090.538971:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552358400 00000100:00100000:0.0:1787853090.538985:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1787853090.538992:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4910d12580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874699552358016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853090.539038:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4910d12580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874699552358016:12345-0@lo:400:kworker.0 Request processed in 46us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853090.539044:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1787853090.539060:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1787853090.539072:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493c5a4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874699552358272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853090.539105:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493c5a4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874699552358272:12345-0@lo:400:kworker.0 Request processed in 34us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853090.539111:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1787853090.539122:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1787853090.539127:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4910d12d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874699552358400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853090.539151:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4910d12d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874699552358400:12345-0@lo:400:kworker.0 Request processed in 24us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853090.539157:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1787853090.539175:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787853090.539182:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493c5a7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874699552358144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853090.539210:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493c5a7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874699552358144:12345-0@lo:400:kworker.0 Request processed in 28us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853090.539329:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787853090.539338:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4910d10b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1874699552358528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853090.539370:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4910d10b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1874699552358528:12345-0@lo:400:kworker.0 Request processed in 35us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853090.539376:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787853090.539410:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49342370c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1874699552358272:0@lo:400:kworker.0 00000100:00100000:1.0:1787853090.539419:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4934234780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552358144:0@lo:400:kworker.0 00000100:00100000:1.0:1787853090.539455:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552357888 00000100:00100000:1.0:1787853090.539459:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552357888 00000100:00100000:1.0:1787853090.539486:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1787853090.539491:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4911c03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+19:3309:x1874699552357888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853090.539519:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4911c03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+19:3309:x1874699552357888:12345-0@lo:400:kworker.0 Request processed in 28us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853090.539535:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1787853090.539604:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4934236d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5d48a955-7010-4118-9c7d-f396984ae1ff:3309:1874699552357888:0@lo:400:kworker.0 00000100:00100000:1.0:1787853090.539613:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4934235a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1874699552358400:0@lo:400:kworker.0 00000100:00100000:1.0:1787853090.539622:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4934236580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874699552358016:0@lo:400:kworker.0 00010000:00080000:1.0:1787853090.539632:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f4934234000 x1874699552358528/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787853106 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787853090.539641:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4934234000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874699552358528:0@lo:400:kworker.0 00000100:00080000:1.0:1787853090.539674:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787853090.539678:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787853090.539680:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787853090.543635:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00010000:2.0:1787853090.603972:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787853091.050027:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4941af2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552358656:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787853091.050132:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853091.050538:0:10348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552358656 00000100:00100000:0.0:1787853091.050546:0:10348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552358656 00000100:00100000:0.0:1787853091.050624:0:10348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787853091.050632:0:10348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4934234000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874699552358656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787853091.050860:0:10348:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787853091.050913:0:10348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4934234000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874699552358656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 281us (792us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853091.050921:0:10348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787853091.050982:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4934236580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874699552358784:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787853091.051013:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853091.051238:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4941af2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552358656:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787853091.051348:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552358784 00000100:00100000:1.0:1787853091.051353:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552358784 00000100:00100000:1.0:1787853091.051386:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787853091.051393:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49065d7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874699552358784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787853091.051416:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787853091.051460:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49065d7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874699552358784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853091.051466:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:3.0:1787853091.051538:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f4934236580 x1874699552358784/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787853107 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787853091.051563:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4934236580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874699552358784:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787853091.625856:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787853092.649706:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787853093.187781:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853093.187850:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853093.188030:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526103936 00000100:00100000:1.0:1787853093.188040:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526103936 00000100:00100000:1.0:1787853093.188118:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 135 00000100:00100000:1.0:1787853093.188130:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49065d4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+5:2365:x1874699526103936:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:1.0:1787853093.188210:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49065d4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+5:2365:x1874699526103936:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 83us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853093.188219:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 135 00000100:00080000:2.0:1787853093.188519:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787853093.188628:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526103808 00000100:00100000:0.0:1787853093.188633:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526103808 00000100:00100000:0.0:1787853093.188669:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 288 00000100:00100000:0.0:1787853093.188694:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4911c00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af755b38-4932-400a-92cc-ddad0ca077a5+13:2365:x1874699526103808:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:0.0:1787853093.188739:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4911c00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af755b38-4932-400a-92cc-ddad0ca077a5+13:2365:x1874699526103808:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 48us (969us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853093.188746:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 288 00000100:00100000:3.0:1787853093.203447:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853093.203511:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853093.203623:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526104064 00000100:00100000:2.0:1787853093.203634:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526104064 00000100:00100000:2.0:1787853093.203725:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 20 00000100:00100000:2.0:1787853093.203736:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49065d5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+5:2361:x1874699526104064:12345-192.168.204.1@tcp:9:kworker.0 00000020:00000080:2.0:1787853093.203767:0:6681:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x710df789068e633c 00000100:00080000:2.0:1787853093.203775:0:6681:0:(import.c:65:import_set_state_nolock()) ffff8f493430c800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787853093.203823:0:6681:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:2.0:1787853093.204141:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49065d5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+2:2361:x1874699526104064:12345-192.168.204.1@tcp:9:kworker.0 Request processed in 407us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853093.204150:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 20 00010000:00010000:2.0:1787853093.204189:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787853093.204658:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787853093.205029:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526104192 00000100:00100000:1.0:1787853093.205036:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526104192 00000100:00080000:3.0:1787853093.205145:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787853093.205198:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 136 00000100:00100000:1.0:1787853093.205208:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49065d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ea3b4e1-e827-460f-be07-19e86dff3d79+5:2364:x1874699526104192:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:1.0:1787853093.205271:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49065d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ea3b4e1-e827-460f-be07-19e86dff3d79+5:2364:x1874699526104192:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 65us (1835us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853093.205278:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 136 00010000:00010000:0.0:1787853093.676315:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787853094.697798:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787853095.659840:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4941af2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552359168:0@lo:400:kworker.0 00000100:00100000:0.0:1787853095.659915:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853095.660014:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787853095.660021:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4941af0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1874699552359296:0@lo:400:kworker.0 00000100:00100000:0.0:1787853095.660050:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853095.660412:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4941af3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874699552359040:0@lo:400:kworker.0 00000100:00100000:1.0:1787853095.660466:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853095.660514:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4941af03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874699552359552:0@lo:400:kworker.0 00000100:00100000:1.0:1787853095.660538:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853095.660565:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787853095.660598:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4941af2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5d48a955-7010-4118-9c7d-f396984ae1ff:3309:1874699552358912:0@lo:400:kworker.0 00000100:00100000:1.0:1787853095.660628:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853095.660648:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4941af1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1874699552359424:0@lo:400:kworker.0 00000100:00100000:1.0:1787853095.660669:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853095.660704:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552359296 00000100:00100000:1.0:1787853095.660712:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552359296 00000100:00100000:1.0:1787853095.660759:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552359040 00000100:00100000:1.0:1787853095.660762:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552359040 00000100:00100000:1.0:1787853095.660775:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552359424 00000100:00100000:1.0:1787853095.660777:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552359424 00000100:00100000:1.0:1787853095.660795:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1787853095.660802:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4910d11680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874699552359296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853095.660859:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4910d11680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874699552359296:12345-0@lo:400:kworker.0 Request processed in 57us (808us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853095.660866:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1787853095.660883:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1787853095.660889:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4934235a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874699552359040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853095.660920:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4934235a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874699552359040:12345-0@lo:400:kworker.0 Request processed in 32us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853095.660927:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1787853095.660939:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1787853095.660959:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4934234780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874699552359424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853095.661009:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4934234780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874699552359424:12345-0@lo:400:kworker.0 Request processed in 52us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853095.661026:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1787853095.661071:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4941af1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1874699552359424:0@lo:400:kworker.0 00000100:00100000:1.0:1787853095.661083:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4941af3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874699552359040:0@lo:400:kworker.0 00000100:00100000:1.0:1787853095.661115:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4941af0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1874699552359296:0@lo:400:kworker.0 00000100:00080000:3.0:1787853095.661681:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787853095.661746:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552359168 00000100:00100000:2.0:1787853095.661753:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552359168 00000100:00100000:2.0:1787853095.661815:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552359552 00000100:00100000:2.0:1787853095.661818:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552359552 00000100:00100000:2.0:1787853095.661848:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787853095.661856:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4910d12940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874699552359168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853095.661912:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4910d12940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874699552359168:12345-0@lo:400:kworker.0 Request processed in 57us (1997us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853095.661918:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787853095.661931:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787853095.661936:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4934236d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1874699552359552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853095.661991:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4934236d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1874699552359552:12345-0@lo:400:kworker.0 Request processed in 54us (1451us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853095.662006:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787853095.662026:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552358912 00000100:00100000:2.0:1787853095.662029:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552358912 00000100:00100000:2.0:1787853095.662052:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1787853095.662059:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4911c03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d48a955-7010-4118-9c7d-f396984ae1ff+19:3309:x1874699552358912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853095.662090:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4911c03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d48a955-7010-4118-9c7d-f396984ae1ff+19:3309:x1874699552358912:12345-0@lo:400:kworker.0 Request processed in 32us (1462us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853095.662097:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1787853095.662144:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4941af2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552359168:0@lo:400:kworker.0 00000100:00080000:3.0:1787853095.662595:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787853095.662599:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787853095.665349:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4941af2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5d48a955-7010-4118-9c7d-f396984ae1ff:3309:1874699552358912:0@lo:400:kworker.0 00010000:00080000:1.0:1787853095.665375:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f4941af03c0 x1874699552359552/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787853111 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787853095.665388:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4941af03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874699552359552:0@lo:400:kworker.0 00010000:00010000:2.0:1787853095.721950:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787853096.169872:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4941af2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552359680:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787853096.169954:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853096.170146:0:10348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552359680 00000100:00100000:0.0:1787853096.170154:0:10348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552359680 00000100:00100000:0.0:1787853096.170212:0:10348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787853096.170221:0:10348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49342370c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874699552359680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787853096.170256:0:10348:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787853096.170307:0:10348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49342370c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874699552359680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853096.170314:0:10348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787853096.170531:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4941af2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552359680:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787853096.170807:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787853096.170816:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4910d13c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552359808:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787853096.170861:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853096.170952:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552359808 00000100:00100000:1.0:1787853096.170956:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552359808 00000100:00100000:1.0:1787853096.171001:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787853096.171009:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4941af2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874699552359808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787853096.171029:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787853096.171071:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4941af2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874699552359808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853096.171078:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00080000:2.0:1787853096.171198:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f4910d13c00 x1874699552359808/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787853112 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787853096.171213:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4910d13c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552359808:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787853096.745971:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787853097.337161:0:6712:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b1d98f5a-0be0-4f69-83a6-833c935c8205 00000020:00000080:3.0:1787853097.337190:0:6712:0:(genops.c:885:class_export_put()) final put ffff8f4934308800/b1d98f5a-0be0-4f69-83a6-833c935c8205 00000020:00000080:2.0:1787853097.340212:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff8f4934308800/b1d98f5a-0be0-4f69-83a6-833c935c8205 for lustre-OST0000 00000020:00000080:2.0:1787853097.344388:0:475:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f493430c800 for lustre-OST0000 00010000:00010000:3.0:1787853097.769778:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787853098.303412:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853098.303454:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853098.303492:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853098.303523:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526104448 00000100:00100000:0.0:1787853098.303533:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526104448 00000100:00100000:0.0:1787853098.303619:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526104576 00000100:00100000:0.0:1787853098.303623:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526104576 00000100:00100000:0.0:1787853098.303662:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 140 00000100:00100000:0.0:1787853098.303699:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4910d13c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+5:2365:x1874699526104448:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:3.0:1787853098.303718:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 141 00000100:00100000:3.0:1787853098.303727:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493fd54b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ea3b4e1-e827-460f-be07-19e86dff3d79+5:2364:x1874699526104576:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:1.0:1787853098.303814:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526104320 00000100:00100000:1.0:1787853098.303818:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526104320 00000100:00080000:2.0:1787853098.303902:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787853098.304053:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 290 00000100:00100000:1.0:1787853098.304062:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4911c02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af755b38-4932-400a-92cc-ddad0ca077a5+13:2364:x1874699526104320:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:0.0:1787853098.304117:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4910d13c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+5:2365:x1874699526104448:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 420us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853098.304122:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493fd54b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ea3b4e1-e827-460f-be07-19e86dff3d79+5:2364:x1874699526104576:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 397us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853098.304126:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 140 00000100:00100000:3.0:1787853098.304129:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 141 00000100:00100000:1.0:1787853098.305894:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4911c02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af755b38-4932-400a-92cc-ddad0ca077a5+13:2364:x1874699526104320:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 1824us (2481us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853098.305913:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 290 00010000:00010000:0.0:1787853098.793764:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853099.819381:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787853100.777904:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4941af12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874699552360064:0@lo:400:kworker.0 00000100:00100000:1.0:1787853100.777980:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853100.778034:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4941af03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874699552360576:0@lo:400:kworker.0 00000100:00100000:1.0:1787853100.778056:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853100.778094:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787853100.778099:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4941af0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5d48a955-7010-4118-9c7d-f396984ae1ff:3309:1874699552359936:0@lo:400:kworker.0 00000100:00100000:1.0:1787853100.778125:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853100.778143:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4941af21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1874699552360448:0@lo:400:kworker.0 00000100:00100000:1.0:1787853100.778159:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853100.778183:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552360576 00000100:00100000:1.0:1787853100.778189:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552360576 00000100:00100000:1.0:1787853100.778235:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787853100.778242:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4921694f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1874699552360576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853100.778304:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4921694f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1874699552360576:12345-0@lo:400:kworker.0 Request processed in 62us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853100.778312:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787853100.778322:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4941af3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1874699552360320:0@lo:400:kworker.0 00000100:00100000:1.0:1787853100.778345:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552359936 00000100:00100000:1.0:1787853100.778350:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552359936 00000100:00100000:3.0:1787853100.778377:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853100.778381:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:1.0:1787853100.778389:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4911c01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+19:3309:x1874699552359936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853100.778406:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787853100.778414:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4941af0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874699552360192:0@lo:400:kworker.0 00000100:00100000:1.0:1787853100.778424:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4911c01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+19:3309:x1874699552359936:12345-0@lo:400:kworker.0 Request processed in 35us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853100.778430:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1787853100.778445:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853100.778478:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552360064 00000100:00100000:1.0:1787853100.778480:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552360448 00000100:00100000:3.0:1787853100.778482:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552360064 00000100:00100000:1.0:1787853100.778499:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552360448 00000100:00100000:3.0:1787853100.778511:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552360320 00000100:00100000:3.0:1787853100.778515:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552360320 00000100:00100000:1.0:1787853100.778528:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787853100.778538:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4934236580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874699552360064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853100.778544:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1787853100.778554:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4904cd7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874699552360448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853100.778604:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4934236580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874699552360064:12345-0@lo:400:kworker.0 Request processed in 68us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853100.778611:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1787853100.778623:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4904cd7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874699552360448:12345-0@lo:400:kworker.0 Request processed in 70us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853100.778628:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1787853100.778637:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1787853100.778639:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49065d4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874699552360320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853100.778662:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552360192 00000100:00100000:3.0:1787853100.778667:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552360192 00000100:00100000:1.0:1787853100.778677:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49065d4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874699552360320:12345-0@lo:400:kworker.0 Request processed in 39us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853100.778684:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1787853100.778701:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00080000:1.0:1787853100.778704:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787853100.778710:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49415a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874699552360192:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1787853100.778710:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787853100.778714:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787853100.778747:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4941af0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5d48a955-7010-4118-9c7d-f396984ae1ff:3309:1874699552359936:0@lo:400:kworker.0 00000100:00100000:3.0:1787853100.778753:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49415a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874699552360192:12345-0@lo:400:kworker.0 Request processed in 43us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853100.778765:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4941af21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1874699552360448:0@lo:400:kworker.0 00000100:00100000:1.0:1787853100.778773:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4941af12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874699552360064:0@lo:400:kworker.0 00010000:00080000:1.0:1787853100.778784:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f4941af03c0 x1874699552360576/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787853116 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787853100.778789:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787853100.778800:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4941af03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874699552360576:0@lo:400:kworker.0 00000100:00100000:3.0:1787853100.778837:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4941af0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874699552360192:0@lo:400:kworker.0 00000100:00100000:3.0:1787853100.778850:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4941af3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1874699552360320:0@lo:400:kworker.0 00000040:00080000:1.0:1787853100.788826:0:11690:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787853100.841792:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787853101.290093:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f493fd56940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874699552360832:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787853101.290237:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853101.290351:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787853101.290358:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4941af2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874699552360704:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787853101.290394:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853101.290617:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552360832 00000100:00100000:0.0:1787853101.290627:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552360832 00000100:00100000:0.0:1787853101.290692:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552360704 00000100:00100000:0.0:1787853101.290695:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552360704 00000100:00100000:0.0:1787853101.290716:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787853101.290736:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49418a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874699552360832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787853101.290786:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787853101.290845:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49418a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874699552360832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853101.290853:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787853101.290877:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787853101.290883:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49418a0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874699552360704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787853101.290904:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787853101.290931:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49418a0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874699552360704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 48us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853101.290937:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787853101.291251:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4941af2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874699552360704:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1787853101.291267:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f493fd56940 x1874699552360832/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787853117 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787853101.291282:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f493fd56940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874699552360832:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787853101.867290:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787853102.723550:0:11856:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 13:51:40 (1787853100) 00010000:00010000:1.0:1787853102.890240:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787853103.427446:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853103.427510:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853103.427624:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853103.428022:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526104960 00000100:00100000:3.0:1787853103.428035:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526104960 00000100:00100000:3.0:1787853103.428249:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526104832 00000100:00100000:3.0:1787853103.428253:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526104832 00000100:00100000:3.0:1787853103.428301:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 145 00000100:00100000:3.0:1787853103.428313:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493fd570c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ea3b4e1-e827-460f-be07-19e86dff3d79+5:2365:x1874699526104960:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:2.0:1787853103.428598:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 146 00000100:00100000:2.0:1787853103.428611:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493fd56940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+5:2365:x1874699526104832:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:2.0:1787853103.428698:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493fd56940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+5:2365:x1874699526104832:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 92us (1075us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853103.428707:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 146 00000100:00100000:3.0:1787853103.429017:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493fd570c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ea3b4e1-e827-460f-be07-19e86dff3d79+5:2365:x1874699526104960:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 706us (1505us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853103.429025:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 145 00000100:00100000:1.0:1787853103.429862:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526104704 00000100:00100000:1.0:1787853103.429874:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526104704 00000100:00100000:1.0:1787853103.429943:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 292 00000100:00100000:1.0:1787853103.429952:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4907f78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af755b38-4932-400a-92cc-ddad0ca077a5+13:2365:x1874699526104704:12345-192.168.204.1@tcp:400:kworker.0 00000100:00080000:0.0:1787853103.430014:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787853103.430021:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4907f78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af755b38-4932-400a-92cc-ddad0ca077a5+13:2365:x1874699526104704:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 72us (2666us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853103.430029:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 292 00010000:00010000:3.0:1787853103.913735:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787853104.727875:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853104.728163:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526105088 00000100:00100000:2.0:1787853104.728174:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526105088 00000100:00100000:2.0:1787853104.728320:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 32 00000100:00100000:2.0:1787853104.728332:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f492eb761c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+5:10255:x1874699526105088:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787853104.728352:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853104.731835:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9e00/0x710df789068e6407 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c5079389649 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853104.731985:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9c00/0x710df789068e640e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853104.732061:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9c00/0x710df789068e640e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853104.732078:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9c00/0x710df789068e640e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787853104.732528:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787853104.732533:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787853104.732805:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9c00/0x710df789068e640e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853104.732838:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9e00/0x710df789068e6407 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389649 expref: 7 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853104.732925:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9c00/0x710df789068e640e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389649 expref: 6 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853104.732935:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f4910aab000) 00010000:00010000:2.0:1787853104.732939:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787853104.732942:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49415b9c00, rc 0) 00000100:00100000:2.0:1787853104.733144:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f492eb761c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+6:10255:x1874699526105088:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 Request processed in 4813us (5286us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853104.733153:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 32 00000100:00100000:2.0:1787853104.757176:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853104.757260:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526105216 00000100:00100000:3.0:1787853104.757269:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526105216 00000100:00100000:3.0:1787853104.757344:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 33 00000100:00100000:3.0:1787853104.757355:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4941af0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+6:10256:x1874699526105216:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787853104.757377:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853104.757399:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21a00/0x710df789068e6415 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c5079389650 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853104.757464:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e641c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853104.757490:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e641c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853104.757520:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e641c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853104.757537:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20e00/0x710df789068e6423 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853104.757544:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20e00/0x710df789068e6423 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853104.757550:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20e00/0x710df789068e6423 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853104.758319:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21000/0x710df789068e642a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853104.758330:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21000/0x710df789068e642a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853104.758339:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21000/0x710df789068e642a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787853104.758427:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1787853104.758432:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1787853104.758642:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21000/0x710df789068e642a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853104.758654:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e641c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853104.758661:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e641c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853104.758679:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e641c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853104.758685:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4921e20c00 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:3.0:1787853104.758689:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e641c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853104.758697:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e641c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853104.758710:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f4910aab000) 00010000:00010000:3.0:1787853104.758713:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787853104.758718:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e641c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853104.758724:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e641c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853104.758737:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20e00/0x710df789068e6423 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853104.758744:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20e00/0x710df789068e6423 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853104.758749:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20e00/0x710df789068e6423 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853104.758753:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4921e20e00 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:3.0:1787853104.758756:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20e00/0x710df789068e6423 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853104.758771:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20e00/0x710df789068e6423 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853104.758779:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8f4910f92000) 00010000:00010000:3.0:1787853104.758781:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787853104.758784:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20e00/0x710df789068e6423 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853104.758789:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20e00/0x710df789068e6423 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853104.758819:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21a00/0x710df789068e6415 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389650 expref: 8 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853104.758833:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21000/0x710df789068e642a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389650 expref: 7 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853104.758841:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8f4910f92900) 00010000:00010000:3.0:1787853104.758842:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787853104.758844:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4921e21000, rc 0) 00000100:00100000:3.0:1787853104.758992:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4941af0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+7:10256:x1874699526105216:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 Request processed in 1637us (1824us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853104.759002:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 33 00000100:00100000:1.0:1787853104.773629:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853104.773817:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526105472 00000100:00100000:0.0:1787853104.773827:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526105472 00000100:00100000:0.0:1787853104.773943:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 34 00000100:00100000:0.0:1787853104.773953:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49418a21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+7:10256:x1874699526105472:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787853104.773984:0:8462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853104.774006:0:8462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6600/0x710df789068e6431 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c5079389657 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853104.774091:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6800/0x710df789068e6438 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853104.774105:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6800/0x710df789068e6438 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853104.774118:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6800/0x710df789068e6438 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853104.774173:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7200/0x710df789068e643f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853104.774181:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7200/0x710df789068e643f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853104.774188:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7200/0x710df789068e643f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853104.775335:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ade00/0x710df789068e6446 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853104.775351:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ade00/0x710df789068e6446 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853104.775360:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ade00/0x710df789068e6446 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787853104.775372:0:8462:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:1.0:1787853104.776281:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6800/0x710df789068e6438 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853104.776292:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6800/0x710df789068e6438 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853104.776307:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6800/0x710df789068e6438 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853104.776314:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b6800 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:1.0:1787853104.776318:0:8462:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6800/0x710df789068e6438 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853104.776325:0:8462:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6800/0x710df789068e6438 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853104.776340:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8f4910f92900) 00010000:00010000:1.0:1787853104.776343:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787853104.776348:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6800/0x710df789068e6438 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853104.776355:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6800/0x710df789068e6438 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853104.776372:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7200/0x710df789068e643f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853104.776379:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7200/0x710df789068e643f lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853104.776385:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7200/0x710df789068e643f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853104.776390:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b7200 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:1.0:1787853104.776393:0:8462:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7200/0x710df789068e643f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853104.776511:0:8462:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7200/0x710df789068e643f lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853104.776665:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8f491176bc00) 00010000:00010000:1.0:1787853104.776668:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787853104.776672:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7200/0x710df789068e643f lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853104.776679:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7200/0x710df789068e643f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853104.777930:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6600/0x710df789068e6431 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389657 expref: 10 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853104.777954:0:8462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ade00/0x710df789068e6446 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389657 expref: 9 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853104.777963:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f4914d11600) 00010000:00010000:1.0:1787853104.777966:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787853104.777969:0:8462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f492a8ade00, rc 0) 00000100:00100000:1.0:1787853104.778039:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49418a21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+9:10256:x1874699526105472:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 Request processed in 4087us (4507us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1787853104.778048:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 34 00000100:00100000:2.0:1787853104.787044:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853104.787099:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526105600 00000100:00100000:3.0:1787853104.787108:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526105600 00000100:00100000:3.0:1787853104.787172:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 35 00000100:00100000:3.0:1787853104.787183:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4941af3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+9:10256:x1874699526105600:12345-192.168.204.1@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1787853104.787382:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4941af3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+9:10256:x1874699526105600:12345-192.168.204.1@tcp:59:lhsmtool_posix.0 Request processed in 200us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853104.787390:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 35 00000040:00080000:0.0:1787853104.888485:0:11690:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787853104.938348:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787853105.898890:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49415a70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552361216:0@lo:400:kworker.0 00000100:00100000:3.0:1787853105.898958:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853105.899015:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787853105.899021:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f493c5ff0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1874699552361344:0@lo:400:kworker.0 00000100:00100000:3.0:1787853105.899048:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853105.899390:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49415a6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874699552361088:0@lo:400:kworker.0 00000100:00100000:1.0:1787853105.899422:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853105.899448:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f493c5fe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874699552361600:0@lo:400:kworker.0 00000100:00100000:1.0:1787853105.899469:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853105.899518:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787853105.899524:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49415a52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5d48a955-7010-4118-9c7d-f396984ae1ff:3309:1874699552360960:0@lo:400:kworker.0 00000100:00100000:1.0:1787853105.899554:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853105.899603:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f493c5fd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1874699552361472:0@lo:400:kworker.0 00000100:00100000:1.0:1787853105.899627:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853105.899658:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552361216 00000100:00100000:1.0:1787853105.899665:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552361216 00000100:00100000:1.0:1787853105.899711:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552361600 00000100:00100000:1.0:1787853105.899714:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552361600 00000100:00100000:1.0:1787853105.899734:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787853105.899742:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493c5fde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874699552361216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853105.899795:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493c5fde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874699552361216:12345-0@lo:400:kworker.0 Request processed in 53us (837us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853105.899802:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787853105.899818:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787853105.899824:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49418a03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1874699552361600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853105.899867:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49418a03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1874699552361600:12345-0@lo:400:kworker.0 Request processed in 44us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853105.899873:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787853105.899892:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552360960 00000100:00100000:1.0:1787853105.899895:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552360960 00000100:00100000:1.0:1787853105.899918:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:1.0:1787853105.899924:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4906231450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d48a955-7010-4118-9c7d-f396984ae1ff+19:3309:x1874699552360960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853105.899953:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4906231450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d48a955-7010-4118-9c7d-f396984ae1ff+19:3309:x1874699552360960:12345-0@lo:400:kworker.0 Request processed in 29us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853105.899959:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00080000:1.0:1787853105.899982:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787853105.899992:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787853105.900034:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49415a70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552361216:0@lo:400:kworker.0 00000100:00100000:1.0:1787853105.900061:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49415a52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5d48a955-7010-4118-9c7d-f396984ae1ff:3309:1874699552360960:0@lo:400:kworker.0 00010000:00080000:1.0:1787853105.900072:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f493c5fe940 x1874699552361600/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787853121 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787853105.900103:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f493c5fe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874699552361600:0@lo:400:kworker.0 00000100:00100000:2.0:1787853105.900806:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552361344 00000100:00100000:2.0:1787853105.900812:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552361344 00000100:00100000:2.0:1787853105.900882:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552361088 00000100:00100000:2.0:1787853105.900886:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552361088 00000100:00100000:2.0:1787853105.900899:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552361472 00000100:00100000:2.0:1787853105.900901:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552361472 00000100:00100000:2.0:1787853105.900916:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1787853105.900924:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493c5fe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874699552361344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853105.900984:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493c5fe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874699552361344:12345-0@lo:400:kworker.0 Request processed in 60us (1935us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853105.901001:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1787853105.901015:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1787853105.901021:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49418a3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874699552361088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853105.901055:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49418a3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874699552361088:12345-0@lo:400:kworker.0 Request processed in 35us (1633us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853105.901061:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1787853105.901072:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787853105.901412:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49418a30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874699552361472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853105.901447:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49418a30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874699552361472:12345-0@lo:400:kworker.0 Request processed in 369us (1820us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853105.901453:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787853105.901509:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f493c5ff0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1874699552361344:0@lo:400:kworker.0 00000100:00100000:2.0:1787853105.901538:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f493c5fd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1874699552361472:0@lo:400:kworker.0 00000100:00100000:2.0:1787853105.901549:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49415a6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874699552361088:0@lo:400:kworker.0 00000100:00080000:1.0:1787853105.903107:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787853105.989716:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787853106.409991:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f492eb752c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552361728:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787853106.410068:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853106.410336:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787853106.410386:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4941af1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552361856:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787853106.410421:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853106.410652:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552361728 00000100:00100000:2.0:1787853106.410661:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552361728 00000100:00100000:2.0:1787853106.410755:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552361856 00000100:00100000:2.0:1787853106.410759:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552361856 00000100:00100000:1.0:1787853106.410795:0:10348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787853106.410807:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787853106.410812:0:10348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49418a1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874699552361728:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787853106.410824:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493436f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874699552361856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787853106.410855:0:10348:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00002000:00000024:0.0:1787853106.410856:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787853106.410920:0:10348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49418a1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874699552361728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 115us (850us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853106.410928:0:10348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787853106.410972:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4941af1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552361856:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787853106.410988:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493436f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874699552361856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 168us (563us total) trans 0 rc 0/0 00010000:00080000:1.0:1787853106.410990:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f492eb752c0 x1874699552361728/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787853122 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787853106.411008:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f492eb752c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552361728:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787853106.411126:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00010000:0.0:1787853106.993378:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787853107.240432:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853107.243823:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526105728 00000100:00100000:0.0:1787853107.243842:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526105728 00000100:00100000:0.0:1787853107.243992:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 36 00000100:00100000:0.0:1787853107.244005:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4941af2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+9:10299:x1874699526105728:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:0.0:1787853107.244032:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853107.244060:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e6454 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c507938965e expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853107.244152:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7800/0x710df789068e645b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853107.244170:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7800/0x710df789068e645b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853107.244207:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7800/0x710df789068e645b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853107.244227:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7600/0x710df789068e6462 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853107.244235:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7600/0x710df789068e6462 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853107.244257:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7600/0x710df789068e6462 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853107.244650:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7800/0x710df789068e645b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853107.244660:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7800/0x710df789068e645b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853107.244668:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7800/0x710df789068e645b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853107.244676:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b7800 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:0.0:1787853107.244682:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7800/0x710df789068e645b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853107.244692:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7800/0x710df789068e645b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853107.244708:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f4910aab000) 00010000:00010000:0.0:1787853107.244711:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787853107.244717:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7800/0x710df789068e645b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853107.244725:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7800/0x710df789068e645b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853107.244740:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7600/0x710df789068e6462 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853107.244747:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7600/0x710df789068e6462 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853107.244761:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7600/0x710df789068e6462 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853107.244767:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b7600 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:0.0:1787853107.244771:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7600/0x710df789068e6462 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853107.244778:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7600/0x710df789068e6462 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853107.244788:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8f491176be00) 00010000:00010000:0.0:1787853107.244791:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787853107.244794:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7600/0x710df789068e6462 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853107.244801:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7600/0x710df789068e6462 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853107.244850:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e6454 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c507938965e expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853107.244863:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f4910aab000) 00010000:00010000:0.0:1787853107.244866:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787853107.244870:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e6454 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c507938965e expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853107.244886:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49415b6200, rc 0) 00000100:00100000:0.0:1787853107.244990:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4941af2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+9:10299:x1874699526105728:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 987us (4572us total) trans 0 rc 301/301 00000100:00100000:0.0:1787853107.245013:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 36 00000100:00080000:1.0:1787853107.245825:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787853107.255029:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853107.255196:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526105984 00000100:00100000:3.0:1787853107.255220:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526105984 00000100:00100000:3.0:1787853107.255363:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 37 00000100:00100000:3.0:1787853107.255377:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4941af1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+9:10299:x1874699526105984:12345-192.168.204.1@tcp:36:lfs.0 00010000:00010000:3.0:1787853107.255461:0:8462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787853107.255501:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9c00/0x710df789068e640e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389649 expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853107.255525:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f4910aab000) 00010000:00010000:3.0:1787853107.255538:0:8462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787853107.257195:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20e00/0x710df789068e6469 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853107.257231:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20e00/0x710df789068e6469 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853107.257246:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20e00/0x710df789068e6469 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853107.257323:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21a00/0x710df789068e6470 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853107.257338:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21a00/0x710df789068e6470 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853107.257346:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21a00/0x710df789068e6470 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787853107.259663:0:8462:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:3.0:1787853107.259688:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20e00/0x710df789068e6469 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853107.259701:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20e00/0x710df789068e6469 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853107.259710:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20e00/0x710df789068e6469 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853107.259717:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4921e20e00 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:3.0:1787853107.259723:0:8462:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20e00/0x710df789068e6469 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853107.259733:0:8462:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20e00/0x710df789068e6469 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853107.259753:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f4910f92000) 00010000:00010000:3.0:1787853107.259756:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787853107.259762:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20e00/0x710df789068e6469 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853107.259769:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20e00/0x710df789068e6469 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787853107.259877:0:8462:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006a51f761 reply state 000000009ae0328d transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21a00/0x710df789068e6470 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853107.259890:0:8462:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787853107.260330:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4941af1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+10:10299:x1874699526105984:12345-192.168.204.1@tcp:36:lfs.0 Request processed in 4949us (5425us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1787853107.260342:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 37 00010000:00010000:2.0:1787853107.265800:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21a00/0x710df789068e6470 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853107.265832:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21a00/0x710df789068e6470 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853107.265842:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21a00/0x710df789068e6470 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853107.265850:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4921e21a00 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:2.0:1787853107.265856:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21a00/0x710df789068e6470 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853107.265866:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21a00/0x710df789068e6470 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853107.265889:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8f4910f92f00) 00010000:00010000:2.0:1787853107.265892:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787853107.265898:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21a00/0x710df789068e6470 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853107.265905:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21a00/0x710df789068e6470 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853107.370111:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853107.371759:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526106112 00000100:00100000:0.0:1787853107.371779:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526106112 00000100:00100000:0.0:1787853107.371882:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 38 00000100:00100000:0.0:1787853107.371896:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4941af2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+9:10307:x1874699526106112:12345-192.168.204.1@tcp:101:lctl.0 00010000:00010000:0.0:1787853107.371929:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853107.371960:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7600/0x710df789068e6477 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c5079389665 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853107.372051:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7800/0x710df789068e647e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853107.372068:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7800/0x710df789068e647e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853107.372082:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7800/0x710df789068e647e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787853107.372167:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787853107.372171:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1787853107.372323:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7800/0x710df789068e647e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853107.372358:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7600/0x710df789068e6477 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389665 expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853107.372384:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7800/0x710df789068e647e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389665 expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853107.372418:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f491176be00) 00010000:00010000:0.0:1787853107.372421:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787853107.372425:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49415b7800, rc 0) 00000100:00100000:0.0:1787853107.372605:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4941af2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+10:10307:x1874699526106112:12345-192.168.204.1@tcp:101:lctl.0 Request processed in 616us (2408us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853107.372614:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 38 00000100:00100000:2.0:1787853107.423950:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853107.429583:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526106240 00000100:00100000:0.0:1787853107.429606:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526106240 00000100:00100000:0.0:1787853107.429717:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 39 00000100:00100000:0.0:1787853107.429739:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4941af3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+10:10313:x1874699526106240:12345-192.168.204.1@tcp:101:bash.0 00010000:00010000:0.0:1787853107.429767:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853107.429797:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7600/0x710df789068e6485 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c507938966c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853107.429893:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e648c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853107.429911:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e648c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853107.429926:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e648c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853107.429942:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7e00/0x710df789068e6493 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853107.429948:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7e00/0x710df789068e6493 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853107.429974:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7e00/0x710df789068e6493 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853107.430126:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6000/0x710df789068e649a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853107.430135:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6000/0x710df789068e649a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853107.430142:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6000/0x710df789068e649a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787853107.430485:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:0.0:1787853107.430490:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787853107.430550:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6000/0x710df789068e649a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853107.430567:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e648c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853107.430605:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e648c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853107.430613:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e648c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853107.430620:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b6200 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:0.0:1787853107.430684:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e648c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853107.430696:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e648c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853107.430721:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f491176be00) 00010000:00010000:0.0:1787853107.430724:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787853107.430794:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e648c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853107.430802:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e648c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853107.430823:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7e00/0x710df789068e6493 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853107.430830:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7e00/0x710df789068e6493 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853107.430837:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7e00/0x710df789068e6493 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853107.430842:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b7e00 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:0.0:1787853107.430845:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7e00/0x710df789068e6493 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853107.430852:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7e00/0x710df789068e6493 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853107.430860:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8f491176b100) 00010000:00010000:0.0:1787853107.430863:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787853107.430866:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7e00/0x710df789068e6493 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853107.430872:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7e00/0x710df789068e6493 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853107.430926:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7600/0x710df789068e6485 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c507938966c expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853107.430942:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6000/0x710df789068e649a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c507938966c expref: 11 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853107.430950:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8f491176b400) 00010000:00010000:0.0:1787853107.430952:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787853107.430955:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49415b6000, rc 0) 00000100:00100000:0.0:1787853107.431045:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4941af3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+11:10313:x1874699526106240:12345-192.168.204.1@tcp:101:bash.0 Request processed in 1316us (7112us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853107.431054:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 39 00000100:00100000:0.0:1787853107.437607:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853107.437714:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526106496 00000100:00100000:0.0:1787853107.437726:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526106496 00000100:00100000:0.0:1787853107.437794:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 40 00000100:00100000:0.0:1787853107.437804:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f492eb76d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+11:10313:x1874699526106496:12345-192.168.204.1@tcp:101:bash.0 00010000:00010000:0.0:1787853107.437832:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853107.437858:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7600/0x710df789068e64a1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c5079389673 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853107.438030:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7e00/0x710df789068e64a8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853107.438049:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7e00/0x710df789068e64a8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853107.438084:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7e00/0x710df789068e64a8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853107.438103:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e64af lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853107.438110:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e64af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853107.438117:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e64af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787853107.445130:0:5837:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:1.0:1787853107.448418:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ac000/0x710df789068e64b6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853107.448448:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ac000/0x710df789068e64b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853107.448463:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ac000/0x710df789068e64b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853107.448518:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7e00/0x710df789068e64a8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853107.448526:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7e00/0x710df789068e64a8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853107.448534:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7e00/0x710df789068e64a8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853107.448542:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b7e00 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:1.0:1787853107.448547:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7e00/0x710df789068e64a8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853107.448556:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7e00/0x710df789068e64a8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853107.448602:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8f491176b400) 00010000:00010000:1.0:1787853107.448606:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787853107.448613:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7e00/0x710df789068e64a8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853107.448621:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7e00/0x710df789068e64a8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787853107.450400:0:5837:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ac11f81f reply state 0000000034f7f3f2 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e64af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853107.450411:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787853107.450478:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7600/0x710df789068e64a1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389673 expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853107.450495:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ac000/0x710df789068e64b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389673 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853107.450506:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f4914d11a00) 00010000:00010000:1.0:1787853107.450509:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787853107.450512:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f492a8ac000, rc 0) 00000100:00100000:1.0:1787853107.450641:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f492eb76d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+14:10313:x1874699526106496:12345-192.168.204.1@tcp:101:bash.0 Request processed in 12826us (13071us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1787853107.450653:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 40 00000100:00100000:1.0:1787853107.460126:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00010000:00010000:0.0:1787853107.460289:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e64af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853107.460306:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e64af lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853107.460315:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e64af lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853107.460323:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b6200 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:0.0:1787853107.460329:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e64af lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853107.460339:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e64af lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853107.460366:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8f491176b100) 00010000:00010000:0.0:1787853107.460369:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787853107.460392:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e64af lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853107.460399:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e64af lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853107.462485:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526106624 00000100:00100000:2.0:1787853107.462505:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526106624 00000100:00100000:2.0:1787853107.462603:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 21 00000100:00100000:2.0:1787853107.462614:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49418a2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2361:x1874699526106624:12345-192.168.204.1@tcp:8:bash.0 00010000:00080000:2.0:1787853107.462676:0:6682:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0001: connection from b1d98f5a-0be0-4f69-83a6-833c935c8205@192.168.204.1@tcp t0 exp 0000000000000000 cur 427 last 0 00000020:00000080:2.0:1787853107.462751:0:6682:0:(genops.c:1385:class_connect()) connect: client b1d98f5a-0be0-4f69-83a6-833c935c8205, cookie 0x710df789068e64c4 00002000:00100000:2.0:1787853107.462783:0:6682:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli b1d98f5a-0be0-4f69-83a6-833c935c8205/ffff8f4906525000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113954 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787853107.462816:0:6682:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787853107.464277:0:6682:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787853107.464353:0:6682:0:(import.c:65:import_set_state_nolock()) ffff8f4906524800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787853107.464476:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49418a2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+6:2361:x1874699526106624:12345-192.168.204.1@tcp:8:bash.0 Request processed in 1860us (4368us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853107.464488:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 21 00000100:00100000:0.0:1787853107.472875:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853107.472934:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526106752 00000100:00100000:0.0:1787853107.472948:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526106752 00000100:00080000:3.0:1787853107.472991:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787853107.473035:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 22 00000100:00100000:0.0:1787853107.473048:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f492eb76940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+6:0:x1874699526106752:12345-192.168.204.1@tcp:101:bash.0 00010000:00010000:0.0:1787853107.473071:0:6684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853107.473102:0:6684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004fdc8612/0x710df789068e64cb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c507938967a expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787853107.473140:0:6684:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787853107.473181:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=427s v=(0 0) 00010000:00010000:0.0:1787853107.473187:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787853107.473211:0:6684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004fdc8612/0x710df789068e64cb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c507938967a expref: 7 pid: 6684 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853107.473238:0:6684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004fdc8612/0x710df789068e64cb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c507938967a expref: 7 pid: 6684 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853107.473256:0:6684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49415b7200, rc 0) 00000100:00100000:0.0:1787853107.473327:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f492eb76940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+7:0:x1874699526106752:12345-192.168.204.1@tcp:101:bash.0 Request processed in 282us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853107.473334:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 22 00000100:00100000:1.0:1787853107.491424:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853107.491563:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526106880 00000100:00100000:3.0:1787853107.491602:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526106880 00000100:00100000:3.0:1787853107.491674:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 23 00000100:00100000:3.0:1787853107.491686:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49418a1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+7:10313:x1874699526106880:12345-192.168.204.1@tcp:101:bash.0 00010000:00010000:3.0:1787853107.491710:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853107.491738:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008dbaa99c/0x710df789068e64d2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c5079389681 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853107.491780:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004fdc8612/0x710df789068e64cb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c507938967a expref: 8 pid: 6684 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853107.491791:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787853107.491797:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787853107.491931:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008dbaa99c/0x710df789068e64d2 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389681 expref: 8 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853107.491977:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004fdc8612/0x710df789068e64cb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.1@tcp remote: 0xd0a9c507938967a expref: 8 pid: 6684 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853107.491995:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004fdc8612/0x710df789068e64cb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c507938967a expref: 8 pid: 6684 timeout: 527 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853107.492035:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f493c5ff480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6682:1874699552361984:192.168.204.1@tcp:104: 00000100:00100000:3.0:1787853107.492316:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f4905074a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787853107.505614:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853107.505656:0:11175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526107008 00000100:00100000:0.0:1787853107.505668:0:11175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526107008 00010000:00010000:0.0:1787853107.505728:0:11175:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004fdc8612/0x710df789068e64cb lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c507938967a expref: 9 pid: 6684 timeout: 527 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853107.505795:0:11175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 35 00000100:00100000:0.0:1787853107.505812:0:11175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f492eb770c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b1d98f5a-0be0-4f69-83a6-833c935c8205+9:2363:x1874699526107008:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787853107.505832:0:11175:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787853107.505862:0:11175:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004fdc8612/0x710df789068e64cb lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c507938967a expref: 9 pid: 6684 timeout: 527 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853107.505880:0:11175:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004fdc8612/0x710df789068e64cb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c507938967a expref: 9 pid: 6684 timeout: 527 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853107.505914:0:11175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787853107.505920:0:11175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787853107.505930:0:11175:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008dbaa99c/0x710df789068e64d2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389681 expref: 9 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853107.505942:0:11175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008dbaa99c/0x710df789068e64d2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389681 expref: 9 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853107.505992:0:11175:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000008dbaa99c/0x710df789068e64d2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389681 expref: 9 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853107.506009:0:11175:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f492eb77480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11175:1874699552362112:192.168.204.1@tcp:105: 00000100:00100000:0.0:1787853107.506128:0:11175:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f49419c43c0 going to sleep for 11 seconds 00010000:00010000:1.0:1787853107.507957:0:6682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004fdc8612/0x710df789068e64cb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c507938967a expref: 9 pid: 6684 timeout: 527 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853107.507988:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f493c5ff480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6682:1874699552361984:192.168.204.1@tcp:104: 00010000:00010000:1.0:1787853107.508021:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008dbaa99c/0x710df789068e64d2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389681 expref: 8 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853107.508038:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4921e20e00, rc 0) 00000100:00100000:1.0:1787853107.508119:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49418a1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+8:10313:x1874699526106880:12345-192.168.204.1@tcp:101:bash.0 Request processed in 16434us (16708us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853107.508131:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 23 00000100:00100000:2.0:1787853107.522275:0:11175:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f492eb77480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11175:1874699552362112:192.168.204.1@tcp:105: 00010000:00010000:2.0:1787853107.522320:0:11175:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787853107.522408:0:11175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f492eb770c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b1d98f5a-0be0-4f69-83a6-833c935c8205+7:2363:x1874699526107008:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 16597us (16808us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853107.522423:0:11175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 35 00000100:00100000:1.0:1787853107.545905:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853107.551445:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526107264 00000100:00100000:2.0:1787853107.551467:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526107264 00000100:00100000:2.0:1787853107.551563:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 6 00000100:00100000:2.0:1787853107.551599:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49418a2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+13:10313:x1874699526107264:12345-192.168.204.1@tcp:35:bash.0 00000100:00100000:2.0:1787853107.553103:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49418a2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+14:10313:x1874699526107264:12345-192.168.204.1@tcp:35:bash.0 Request processed in 1493us (7203us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1787853107.553130:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 6 00000001:00080000:1.0:1787853107.572908:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967309 is committed 00000001:00080000:1.0:1787853107.572931:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000100:00100000:0.0:1787853107.693284:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853107.693397:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526107520 00000100:00100000:3.0:1787853107.693409:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526107520 00000100:00100000:3.0:1787853107.693484:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 41 00000100:00100000:3.0:1787853107.693502:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f492eb74f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+12:10323:x1874699526107520:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:3.0:1787853107.693533:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853107.693559:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e64d9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c5079389688 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787853107.693743:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:3.0:1787853107.693907:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e64d9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389688 expref: 14 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853107.693924:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f491176be00) 00010000:00010000:3.0:1787853107.693927:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787853107.693933:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e64d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389688 expref: 14 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853107.693950:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4921e20c00, rc 0) 00000100:00100000:3.0:1787853107.694027:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f492eb74f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+13:10323:x1874699526107520:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 535us (758us total) trans 4294967313 rc 301/301 00000100:00100000:3.0:1787853107.694035:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 41 00000100:00100000:2.0:1787853107.698514:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853107.698675:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526107776 00000100:00100000:3.0:1787853107.698689:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526107776 00000100:00100000:3.0:1787853107.698794:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 7 00000100:00100000:3.0:1787853107.698807:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4941af0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+13:10323:x1874699526107776:12345-192.168.204.1@tcp:35:lfs.0 00000100:00100000:3.0:1787853107.699170:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4941af0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+14:10323:x1874699526107776:12345-192.168.204.1@tcp:35:lfs.0 Request processed in 365us (683us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1787853107.699180:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 7 00000100:00100000:3.0:1787853107.815214:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853107.815458:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526107904 00000100:00100000:0.0:1787853107.815471:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526107904 00000100:00100000:0.0:1787853107.815555:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 42 00000100:00100000:0.0:1787853107.815612:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493c5ffc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+14:10329:x1874699526107904:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:0.0:1787853107.815650:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853107.815678:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6e00/0x710df789068e64e7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c507938968f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853107.815775:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6400/0x710df789068e64ee lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853107.816059:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6400/0x710df789068e64ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853107.816078:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6400/0x710df789068e64ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787853107.816282:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:2.0:1787853107.816288:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787853107.816319:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6400/0x710df789068e64ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853107.816357:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6e00/0x710df789068e64e7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c507938968f expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853107.816404:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6400/0x710df789068e64ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c507938968f expref: 15 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853107.816414:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8f491176b400) 00010000:00010000:2.0:1787853107.816419:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787853107.816423:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49415b6400, rc 0) 00000100:00100000:2.0:1787853107.816515:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493c5ffc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+15:10329:x1874699526107904:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 949us (1328us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853107.816525:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 42 00000100:00100000:0.0:1787853107.821898:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853107.822335:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526108160 00000100:00100000:2.0:1787853107.822349:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526108160 00000100:00100000:2.0:1787853107.822432:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 43 00000100:00100000:2.0:1787853107.822444:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f492eb74780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+15:10329:x1874699526108160:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:2.0:1787853107.822469:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853107.822496:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8600/0x710df789068e64f5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c5079389696 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853107.822661:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8200/0x710df789068e64fc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853107.822680:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8200/0x710df789068e64fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853107.822696:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8200/0x710df789068e64fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787853107.822709:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787853107.823051:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8600/0x710df789068e64f5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389696 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853107.823073:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8200/0x710df789068e64fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389696 expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853107.823083:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f4914d11a00) 00010000:00010000:2.0:1787853107.823087:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787853107.823092:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49415b8200, rc 0) 00000100:00100000:2.0:1787853107.823178:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f492eb74780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+17:10329:x1874699526108160:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 736us (1298us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1787853107.823198:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 43 00000100:00100000:3.0:1787853107.827120:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853107.827288:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526108288 00000100:00100000:0.0:1787853107.827300:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526108288 00000100:00100000:0.0:1787853107.827382:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 1 00000100:00100000:0.0:1787853107.827394:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493c5fc780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+17:2364:x1874699526108288:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787853107.827415:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787853107.827451:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8200/0x710df789068e64fc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389696 expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853107.827478:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f4914d11a00) 00010000:00010000:0.0:1787853107.827498:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787853107.827617:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493c5fc780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+16:2364:x1874699526108288:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 224us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853107.827627:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 1 00000100:00100000:1.0:1787853107.831162:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853107.831280:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526108544 00000100:00100000:2.0:1787853107.831293:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526108544 00000100:00100000:2.0:1787853107.831399:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 44 00000100:00100000:2.0:1787853107.831411:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49418a2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+16:10329:x1874699526108544:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:2.0:1787853107.831444:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853107.831472:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8000/0x710df789068e650a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c507938969d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853107.831639:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9e00/0x710df789068e6511 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853107.831659:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9e00/0x710df789068e6511 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853107.831673:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9e00/0x710df789068e6511 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787853107.831713:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787853107.831925:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8000/0x710df789068e650a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c507938969d expref: 19 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853107.831950:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9e00/0x710df789068e6511 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c507938969d expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853107.831958:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f4914d11a00) 00010000:00010000:2.0:1787853107.831961:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787853107.831964:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49415b9e00, rc 0) 00000100:00100000:2.0:1787853107.832049:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49418a2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+18:10329:x1874699526108544:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 639us (900us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1787853107.832057:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 44 00000100:00100000:1.0:1787853107.837806:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853107.837929:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526108672 00000100:00100000:0.0:1787853107.837945:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526108672 00000100:00100000:0.0:1787853107.838030:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 24 00000100:00100000:0.0:1787853107.838044:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49418a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+7:2362:x1874699526108672:12345-192.168.204.1@tcp:1:lfs.0 00010000:00010000:0.0:1787853107.838115:0:6684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c3eb952b/0x710df789068e651f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853107.838159:0:6684:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008dbaa99c/0x710df789068e64d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389681 expref: 7 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853107.838170:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787853107.838177:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787853107.838182:0:6684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c3eb952b/0x710df789068e651f lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853107.838243:0:6684:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008dbaa99c/0x710df789068e64d2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389681 expref: 7 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853107.838261:0:6684:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008dbaa99c/0x710df789068e64d2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389681 expref: 7 pid: 6682 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853107.838280:0:6684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f492eb75e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6684:1874699552362240:192.168.204.1@tcp:104: 00000100:00100000:0.0:1787853107.838409:0:6684:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f49419c40c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787853107.844385:0:6684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f492eb75e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6684:1874699552362240:192.168.204.1@tcp:104: 00010000:00010000:1.0:1787853107.844430:0:6684:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c3eb952b/0x710df789068e651f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853107.848994:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853107.850094:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526108800 00000100:00100000:3.0:1787853107.850113:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526108800 00002000:00100000:3.0:1787853107.850204:0:6687:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff8f49418a3c00 x1874699526108800/t0(0) o4->b1d98f5a-0be0-4f69-83a6-833c935c8205@192.168.204.1@tcp:283/0 lens 504/0 e 0 to 0 dl 1787853118 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787853107.850219:0:6687:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff8f49418a3c00 with x1874699526108800 ext(0->12) 00010000:00010000:3.0:1787853107.850232:0:6687:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000008dbaa99c/0x710df789068e64d2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389681 expref: 8 pid: 6682 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853107.850254:0:6687:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000008dbaa99c/0x710df789068e64d2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389681 expref: 8 pid: 6682 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787853107.850263:0:6687:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8f49418a3c00 00000100:00100000:3.0:1787853107.850305:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 0 00000100:00100000:3.0:1787853107.850316:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49418a3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+8:2364:x1874699526108800:12345-192.168.204.1@tcp:4:lfs.0 00000001:00100000:3.0:1787853107.938413:0:7641:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b1d98f5a-0be0-4f69-83a6-833c935c8205 00010000:00010000:1.0:1787853108.011466:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787853108.046334:0:7641:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:1.0:1787853108.053637:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49418a3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+7:2364:x1874699526108800:12345-192.168.204.1@tcp:4:lfs.0 Request processed in 203313us (204646us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1787853108.053657:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 0 00002000:00100000:1.0:1787853108.053671:0:6687:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff8f49418a3c00 x1874699526108800/t4294967299(0) o4->b1d98f5a-0be0-4f69-83a6-833c935c8205@192.168.204.1@tcp:283/0 lens 504/448 e 0 to 0 dl 1787853118 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787853108.053681:0:6687:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff8f49418a3c00 with x1874699526108800 ext(0->12) 00010000:00010000:1.0:1787853108.053692:0:6687:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000008dbaa99c/0x710df789068e64d2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389681 expref: 7 pid: 6682 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853108.053722:0:6687:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000008dbaa99c/0x710df789068e64d2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389681 expref: 7 pid: 6682 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787853108.053745:0:6687:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8f49418a3c00 00000100:00100000:3.0:1787853108.088356:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853108.088523:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526108928 00000100:00100000:1.0:1787853108.088536:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526108928 00010000:00010000:1.0:1787853108.088625:0:8450:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008dbaa99c/0x710df789068e64d2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389681 expref: 7 pid: 6682 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853108.088661:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 36 00000100:00100000:1.0:1787853108.088671:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493c5fd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+7:2363:x1874699526108928:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787853108.088687:0:8450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1787853108.089023:0:8450:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1787853108.089028:0:8450:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1787853107 00002000:00010000:1.0:1787853108.089031:0:8450:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1787853108 00002000:00010000:1.0:1787853108.089033:0:8450:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1787853107 00002000:00010000:1.0:1787853108.089035:0:8450:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:1.0:1787853108.089043:0:8450:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008dbaa99c/0x710df789068e64d2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389681 expref: 7 pid: 6682 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853108.089059:0:8450:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008dbaa99c/0x710df789068e64d2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389681 expref: 7 pid: 6682 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853108.089089:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008dbaa99c/0x710df789068e64d2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389681 expref: 7 pid: 6682 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853108.089109:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787853108.089114:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787853108.089135:0:8450:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c3eb952b/0x710df789068e651f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853108.089148:0:8450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c3eb952b/0x710df789068e651f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853108.089198:0:8450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787853108.089261:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493c5fd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+6:2363:x1874699526108928:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 592us (917us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853108.089269:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 36 00010000:00010000:0.0:1787853108.089370:0:6684:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c3eb952b/0x710df789068e651f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853108.089381:0:6684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c3eb952b/0x710df789068e651f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853108.089407:0:6684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c3eb952b/0x710df789068e651f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853108.089415:0:6684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c3eb952b/0x710df789068e651f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853108.089423:0:6684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c3eb952b/0x710df789068e651f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853108.089431:0:6684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b7000 already unused, calling callback (ffffffffc1528440) 00010000:00010000:0.0:1787853108.089435:0:6684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c3eb952b/0x710df789068e651f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853108.089444:0:6684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c3eb952b/0x710df789068e651f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853108.089455:0:6684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c3eb952b/0x710df789068e651f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853108.089463:0:6684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c3eb952b/0x710df789068e651f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853108.089524:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49418a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+6:2362:x1874699526108672:12345-192.168.204.1@tcp:1:lfs.0 Request processed in 251485us (251748us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853108.089533:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 24 00000100:00100000:3.0:1787853108.099957:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853108.100098:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526109184 00000100:00100000:2.0:1787853108.100109:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526109184 00000100:00100000:2.0:1787853108.100173:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 8 00000100:00100000:2.0:1787853108.100197:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493c5fcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+18:10329:x1874699526109184:12345-192.168.204.1@tcp:35:lfs.0 00000004:00010000:2.0:1787853108.100269:0:5840:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9e00/0x710df789068e6511 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c507938969d expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787853108.100786:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:2.0:1787853108.100854:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:2.0:1787853108.101513:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:2.0:1787853108.102030:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8600/0x710df789068e6526 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853108.102065:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ac000/0x710df789068e64b6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389673 expref: 22 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853108.102073:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8600/0x710df789068e6526 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853108.102112:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ac000/0x710df789068e64b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389673 expref: 22 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853108.102131:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ac000/0x710df789068e64b6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389673 expref: 22 pid: 5837 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853108.102147:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4941af03c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5840:1874699552362368:192.168.204.1@tcp:104: 00000100:00100000:2.0:1787853108.102271:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f4904c00180 going to sleep for 11 seconds 00000100:00100000:3.0:1787853108.107260:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4941af03c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5840:1874699552362368:192.168.204.1@tcp:104: 00010000:00010000:3.0:1787853108.107309:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8600/0x710df789068e6526 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853108.108154:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853108.108260:0:11175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526109312 00000100:00100000:2.0:1787853108.108269:0:11175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526109312 00010000:00010000:2.0:1787853108.108312:0:11175:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ac000/0x710df789068e64b6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389673 expref: 23 pid: 5837 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853108.108401:0:11175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 37 00000100:00100000:2.0:1787853108.108412:0:11175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49418a0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b1d98f5a-0be0-4f69-83a6-833c935c8205+23:2362:x1874699526109312:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787853108.108429:0:11175:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787853108.108436:0:11175:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ac000/0x710df789068e64b6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389673 expref: 23 pid: 5837 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853108.108449:0:11175:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ac000/0x710df789068e64b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389673 expref: 23 pid: 5837 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853108.108487:0:11175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ac000/0x710df789068e64b6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389673 expref: 23 pid: 5837 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853108.108510:0:11175:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f4914d11a00) 00010000:00010000:2.0:1787853108.108515:0:11175:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8600/0x710df789068e6526 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853108.108524:0:11175:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8600/0x710df789068e6526 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853108.108532:0:11175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8600/0x710df789068e6526 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853108.108563:0:11175:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787853108.108653:0:11175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49418a0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b1d98f5a-0be0-4f69-83a6-833c935c8205+22:2362:x1874699526109312:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 243us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853108.108661:0:11175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 37 00010000:00010000:3.0:1787853108.108832:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8600/0x710df789068e6526 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853108.108840:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8600/0x710df789068e6526 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787853108.108959:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:3.0:1787853108.109166:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:3.0:1787853108.109308:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f493c5fda40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5840:1874699552362496:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787853108.109362:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853108.109400:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f492064e9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787853108.109473:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552362496 00000100:00100000:1.0:1787853108.109479:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552362496 00000100:00100000:1.0:1787853108.109530:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787853108.109538:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493c5fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5840:x1874699552362496:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787853108.109647:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493c5fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5840:x1874699552362496:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 110us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853108.109653:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787853108.109695:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f493c5fda40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5840:1874699552362496:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1787853108.110366:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:1.0:1787853108.110428:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49418a12c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5840:1874699552362624:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787853108.110468:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853108.110493:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f49063f76c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787853108.110514:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552362624 00000100:00100000:1.0:1787853108.110519:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552362624 00000100:00100000:1.0:1787853108.110549:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787853108.110556:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49418a0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5840:x1874699552362624:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787853108.110783:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49418a0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5840:x1874699552362624:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 226us (314us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1787853108.110791:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787853108.110825:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49418a12c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5840:1874699552362624:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1787853108.110868:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:1.0:1787853108.110900:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8600/0x710df789068e6526 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853108.110910:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8600/0x710df789068e6526 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853108.110918:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8600/0x710df789068e6526 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853108.110926:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b8600 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:1.0:1787853108.110930:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8600/0x710df789068e6526 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853108.110939:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8600/0x710df789068e6526 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853108.110956:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f4914d11a00) 00010000:00010000:1.0:1787853108.110959:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787853108.110965:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8600/0x710df789068e6526 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853108.110971:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8600/0x710df789068e6526 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787853108.111126:0:5840:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1787853108.111355:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:1.0:1787853108.111369:0:5840:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 427652798568ns, next at 428652795611ns, rc = 0 00000001:00080000:1.0:1787853108.111376:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:1.0:1787853108.111409:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f4914d11a00) 00010000:00010000:1.0:1787853108.111412:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787853108.111418:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9e00/0x710df789068e6511 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c507938969d expref: 26 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853108.111507:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493c5fcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+25:10329:x1874699526109184:12345-192.168.204.1@tcp:35:lfs.0 Request processed in 11324us (11558us total) trans 4294967325 rc 0/0 00000100:00100000:1.0:1787853108.111514:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 8 00000020:00080000:1.0:1787853108.111518:0:5840:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00080000:3.0:1787853108.115982:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787853108.128208:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853108.136748:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526109440 00000100:00100000:3.0:1787853108.136764:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526109440 00000100:00100000:3.0:1787853108.136842:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 45 00000100:00100000:3.0:1787853108.136853:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4941af12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+25:10329:x1874699526109440:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:3.0:1787853108.136877:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853108.136903:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e652d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c50793896a4 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853108.136970:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e652d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793896a4 expref: 26 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853108.136987:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e652d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793896a4 expref: 26 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853108.137031:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f4910f92b00) 00010000:00010000:3.0:1787853108.137035:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787853108.137039:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4921e20c00, rc 0) 00000100:00100000:3.0:1787853108.137115:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4941af12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+26:10329:x1874699526109440:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 263us (8917us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853108.137123:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 45 00000100:00100000:0.0:1787853108.149648:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853108.149740:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526109696 00000100:00100000:1.0:1787853108.149751:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526109696 00000100:00100000:1.0:1787853108.149823:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 9 00000100:00100000:1.0:1787853108.149834:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4910409050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+26:10329:x1874699526109696:12345-192.168.204.1@tcp:35:lfs.0 00000100:00100000:1.0:1787853108.150094:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4910409050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+27:10329:x1874699526109696:12345-192.168.204.1@tcp:35:lfs.0 Request processed in 260us (457us total) trans 4294967326 rc 0/0 00000100:00100000:1.0:1787853108.150103:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 9 00000100:00100000:1.0:1787853108.312453:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853108.312592:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526109952 00000100:00100000:2.0:1787853108.312603:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526109952 00000100:00100000:2.0:1787853108.312668:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 46 00000100:00100000:2.0:1787853108.312678:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49418a2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+27:10339:x1874699526109952:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:2.0:1787853108.312712:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853108.312732:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9600/0x710df789068e6534 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c50793896ab expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787853108.312865:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:2.0:1787853108.313021:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9600/0x710df789068e6534 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793896ab expref: 29 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853108.313037:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f491176be00) 00010000:00010000:2.0:1787853108.313040:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787853108.313046:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9600/0x710df789068e6534 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793896ab expref: 29 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853108.313062:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49415b9600, rc 0) 00000100:00100000:2.0:1787853108.313557:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49418a2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+28:10339:x1874699526109952:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 878us (1112us total) trans 4294967327 rc 301/301 00000100:00100000:2.0:1787853108.313566:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 46 00000100:00100000:3.0:1787853108.318300:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853108.318386:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526110080 00000100:00100000:2.0:1787853108.318397:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526110080 00000100:00100000:2.0:1787853108.318460:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 47 00000100:00100000:2.0:1787853108.318471:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493c5fcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+28:10339:x1874699526110080:12345-192.168.204.1@tcp:34:lfs.0 00010000:00010000:2.0:1787853108.318556:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e6542 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853108.318612:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e6542 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853108.318625:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e6542 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853108.318641:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9600/0x710df789068e6549 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853108.318649:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9600/0x710df789068e6549 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853108.318676:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9600/0x710df789068e6549 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853108.318813:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8a00/0x710df789068e6550 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853108.318823:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8a00/0x710df789068e6550 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853108.318830:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8a00/0x710df789068e6550 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787853108.318882:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8a00/0x710df789068e6550 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853108.318895:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e6542 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853108.318903:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e6542 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853108.319287:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e6542 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853108.319294:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b8c00 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:2.0:1787853108.319299:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e6542 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853108.319307:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e6542 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853108.319320:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8f491176b400) 00010000:00010000:2.0:1787853108.319330:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787853108.319336:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e6542 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853108.319342:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e6542 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853108.319357:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9600/0x710df789068e6549 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853108.319364:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9600/0x710df789068e6549 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853108.319369:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9600/0x710df789068e6549 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853108.319375:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b9600 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:2.0:1787853108.319378:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9600/0x710df789068e6549 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853108.319384:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9600/0x710df789068e6549 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853108.319392:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8f4910aab300) 00010000:00010000:2.0:1787853108.319394:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787853108.319397:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9600/0x710df789068e6549 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853108.319402:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9600/0x710df789068e6549 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853108.319416:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8a00/0x710df789068e6550 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853108.319428:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8a00/0x710df789068e6550 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853108.319434:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8a00/0x710df789068e6550 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853108.319440:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b8a00 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:2.0:1787853108.319443:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8a00/0x710df789068e6550 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853108.319449:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8a00/0x710df789068e6550 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853108.319457:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f4910f92b00) 00010000:00010000:2.0:1787853108.319459:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787853108.319462:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8a00/0x710df789068e6550 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853108.319468:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8a00/0x710df789068e6550 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853108.319545:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493c5fcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+28:10339:x1874699526110080:12345-192.168.204.1@tcp:34:lfs.0 Request processed in 1074us (1255us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853108.319553:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 47 00000100:00100000:0.0:1787853108.322665:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853108.323204:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526110336 00000100:00100000:1.0:1787853108.323213:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526110336 00000100:00100000:1.0:1787853108.323268:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 10 00000100:00100000:1.0:1787853108.323277:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f492eb75e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+28:10339:x1874699526110336:12345-192.168.204.1@tcp:35:lfs.0 00000100:00100000:1.0:1787853108.323527:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f492eb75e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+29:10339:x1874699526110336:12345-192.168.204.1@tcp:35:lfs.0 Request processed in 250us (871us total) trans 4294967328 rc 0/0 00000100:00100000:1.0:1787853108.323535:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 10 00000100:00100000:1.0:1787853108.419458:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853108.419607:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526110592 00000100:00100000:2.0:1787853108.419617:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526110592 00000100:00100000:2.0:1787853108.419676:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 48 00000100:00100000:2.0:1787853108.419687:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49418a1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+29:10342:x1874699526110592:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:2.0:1787853108.419725:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853108.419764:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8a00/0x710df789068e6557 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c50793896b2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853108.419866:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9600/0x710df789068e655e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853108.419882:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9600/0x710df789068e655e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853108.419895:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9600/0x710df789068e655e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853108.419922:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e6565 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853108.419930:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e6565 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853108.419937:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e6565 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853108.420296:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9e00/0x710df789068e656c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853108.420306:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9e00/0x710df789068e656c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853108.420313:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9e00/0x710df789068e656c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787853108.420323:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787853108.420412:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9600/0x710df789068e655e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853108.420429:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9600/0x710df789068e655e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853108.420435:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9600/0x710df789068e655e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853108.420442:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b9600 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:2.0:1787853108.420446:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9600/0x710df789068e655e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853108.420454:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9600/0x710df789068e655e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853108.420467:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8f491176b400) 00010000:00010000:2.0:1787853108.420470:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787853108.420474:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9600/0x710df789068e655e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853108.420480:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9600/0x710df789068e655e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853108.420495:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e6565 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853108.420501:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e6565 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853108.420506:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e6565 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853108.420511:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b8c00 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:2.0:1787853108.420520:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e6565 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853108.420526:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e6565 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853108.420534:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8f4910aab300) 00010000:00010000:2.0:1787853108.420537:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787853108.420540:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e6565 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853108.420545:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e6565 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853108.420990:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8a00/0x710df789068e6557 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793896b2 expref: 32 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853108.421008:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9e00/0x710df789068e656c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793896b2 expref: 31 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853108.421017:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f4910f92b00) 00010000:00010000:2.0:1787853108.421020:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787853108.421023:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49415b9e00, rc 0) 00000100:00100000:2.0:1787853108.421524:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49418a1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+31:10342:x1874699526110592:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 1417us (1655us total) trans 4294967329 rc 0/0 00000100:00100000:2.0:1787853108.421536:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 48 00000100:00100000:3.0:1787853108.441954:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853108.442149:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526110720 00000100:00100000:2.0:1787853108.442161:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526110720 00000100:00100000:2.0:1787853108.442237:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 49 00000100:00100000:2.0:1787853108.442247:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493c5fe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+31:10342:x1874699526110720:12345-192.168.204.1@tcp:54:lfs.0 00010000:00010000:2.0:1787853108.442330:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8a00/0x710df789068e657a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853108.442347:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8a00/0x710df789068e657a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853108.442359:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8a00/0x710df789068e657a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853108.442397:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8a00/0x710df789068e657a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853108.442405:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8a00/0x710df789068e657a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853108.442412:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8a00/0x710df789068e657a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853108.442419:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b8a00 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:2.0:1787853108.442424:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8a00/0x710df789068e657a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853108.442432:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8a00/0x710df789068e657a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853108.442444:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f4910f92b00) 00010000:00010000:2.0:1787853108.442447:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787853108.442450:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8a00/0x710df789068e657a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853108.442457:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8a00/0x710df789068e657a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853108.442546:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493c5fe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+31:10342:x1874699526110720:12345-192.168.204.1@tcp:54:lfs.0 Request processed in 300us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853108.442553:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 49 00000100:00100000:0.0:1787853108.452442:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853108.452628:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526110976 00000100:00100000:1.0:1787853108.452639:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526110976 00000100:00100000:1.0:1787853108.452705:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 11 00000100:00100000:1.0:1787853108.452716:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f492eb77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+31:10342:x1874699526110976:12345-192.168.204.1@tcp:35:lfs.0 00000100:00100000:1.0:1787853108.452964:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f492eb77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+32:10342:x1874699526110976:12345-192.168.204.1@tcp:35:lfs.0 Request processed in 249us (532us total) trans 4294967330 rc 0/0 00000100:00100000:1.0:1787853108.452972:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 11 00000100:00100000:1.0:1787853108.543542:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853108.543632:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853108.543672:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853108.543698:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853108.543733:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526111360 00000100:00100000:1.0:1787853108.543744:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526111360 00000100:00100000:1.0:1787853108.543814:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 84 00000100:00100000:1.0:1787853108.543825:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49418a1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+5:2365:x1874699526111360:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:1.0:1787853108.543904:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49418a1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+5:2365:x1874699526111360:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 82us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853108.543925:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 84 00000100:00100000:0.0:1787853108.544023:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526111104 00000100:00100000:0.0:1787853108.544028:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526111104 00000100:00100000:0.0:1787853108.544063:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 294 00000100:00100000:0.0:1787853108.544070:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4906231050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af755b38-4932-400a-92cc-ddad0ca077a5+13:2365:x1874699526111104:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:0.0:1787853108.544098:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4906231050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af755b38-4932-400a-92cc-ddad0ca077a5+13:2365:x1874699526111104:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 29us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853108.544105:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 294 00000100:00100000:3.0:1787853108.544638:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526111232 00000100:00100000:3.0:1787853108.544644:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526111232 00000100:00100000:3.0:1787853108.544689:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526111488 00000100:00100000:3.0:1787853108.544692:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526111488 00000100:00100000:3.0:1787853108.544732:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 150 00000100:00100000:3.0:1787853108.544740:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49418a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+32:2365:x1874699526111232:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:3.0:1787853108.544797:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49418a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+32:2365:x1874699526111232:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 58us (1264us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853108.544804:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 150 00000100:00100000:3.0:1787853108.544819:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 151 00000100:00100000:3.0:1787853108.544826:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49418a0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ea3b4e1-e827-460f-be07-19e86dff3d79+5:2365:x1874699526111488:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:3.0:1787853108.544853:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49418a0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ea3b4e1-e827-460f-be07-19e86dff3d79+5:2365:x1874699526111488:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 28us (1221us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853108.544859:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 151 00000100:00080000:1.0:1787853108.547188:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787853108.998298:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853108.998388:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526111744 00000100:00100000:3.0:1787853108.998396:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526111744 00000100:00100000:3.0:1787853108.998464:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 50 00000100:00100000:3.0:1787853108.998488:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49415a61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+32:10373:x1874699526111744:12345-192.168.204.1@tcp:101:cat.0 00010000:00010000:3.0:1787853108.998508:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853108.998529:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21800/0x710df789068e6581 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c50793896b9 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853108.998659:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20400/0x710df789068e6588 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853108.998673:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20400/0x710df789068e6588 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853108.998687:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20400/0x710df789068e6588 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787853108.998697:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1787853108.998856:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21800/0x710df789068e6581 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793896b9 expref: 35 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853108.998878:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20400/0x710df789068e6588 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793896b9 expref: 34 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853108.998887:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f4910f92b00) 00010000:00010000:3.0:1787853108.998890:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787853108.998894:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4921e20400, rc 0) 00000100:00100000:3.0:1787853108.998976:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49415a61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+34:10373:x1874699526111744:12345-192.168.204.1@tcp:101:cat.0 Request processed in 488us (686us total) trans 4294967331 rc 0/0 00000100:00100000:3.0:1787853108.998983:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 50 00000100:00100000:3.0:1787853109.004888:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853109.005022:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526111872 00000100:00100000:2.0:1787853109.005032:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526111872 00000100:00080000:1.0:1787853109.005263:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787853109.005645:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 2 00000100:00100000:2.0:1787853109.005660:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493c5ff840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+34:2364:x1874699526111872:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787853109.005683:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787853109.005726:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20400/0x710df789068e6588 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793896b9 expref: 34 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853109.005746:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f4910f92b00) 00010000:00010000:2.0:1787853109.005751:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787853109.005813:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493c5ff840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+33:2364:x1874699526111872:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 158us (934us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853109.009315:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 2 00000100:00100000:1.0:1787853109.020493:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853109.021004:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526112128 00000100:00100000:2.0:1787853109.021015:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526112128 00000100:00100000:2.0:1787853109.021083:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 12 00000100:00100000:2.0:1787853109.021094:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49415a7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+33:10373:x1874699526112128:12345-192.168.204.1@tcp:35:cat.0 00000100:00100000:2.0:1787853109.021439:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49415a7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+34:10373:x1874699526112128:12345-192.168.204.1@tcp:35:cat.0 Request processed in 346us (955us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1787853109.021448:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 12 00010000:00010000:1.0:1787853109.034189:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787853109.115078:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853109.115439:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526112384 00000100:00100000:2.0:1787853109.115450:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526112384 00000100:00100000:2.0:1787853109.115531:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 51 00000100:00100000:2.0:1787853109.115541:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49415a6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+34:10379:x1874699526112384:12345-192.168.204.1@tcp:101:dd.0 00010000:00010000:2.0:1787853109.116367:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853109.116373:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787853109.116409:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6400/0x710df789068e64ee lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c507938968f expref: 34 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853109.116435:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8f491176b400) 00010000:00010000:2.0:1787853109.116440:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787853109.116455:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8a00/0x710df789068e6596 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c50793896c0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853109.116551:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e659d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853109.116565:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9e00/0x710df789068e656c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793896b2 expref: 34 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853109.116625:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e659d lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853109.116664:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9e00/0x710df789068e656c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793896b2 expref: 34 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853109.116679:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9e00/0x710df789068e656c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793896b2 expref: 34 pid: 5838 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853109.116708:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4941af21c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5838:1874699552362752:192.168.204.1@tcp:104: 00000100:00100000:2.0:1787853109.117754:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f4904c006c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787853109.131671:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853109.131801:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4941af21c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5838:1874699552362752:192.168.204.1@tcp:104: 00010000:00010000:2.0:1787853109.131830:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e659d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853109.131908:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526112512 00000100:00100000:3.0:1787853109.131934:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526112512 00010000:00010000:3.0:1787853109.131972:0:8450:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9e00/0x710df789068e656c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793896b2 expref: 35 pid: 5838 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853109.132011:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 38 00000100:00100000:3.0:1787853109.132019:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f491e971450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+35:2363:x1874699526112512:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787853109.132036:0:8450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787853109.132044:0:8450:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9e00/0x710df789068e656c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793896b2 expref: 35 pid: 5838 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853109.132057:0:8450:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9e00/0x710df789068e656c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793896b2 expref: 35 pid: 5838 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853109.132081:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9e00/0x710df789068e656c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793896b2 expref: 35 pid: 5838 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853109.132099:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f4910f92b00) 00010000:00010000:3.0:1787853109.132103:0:8450:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e659d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853109.132114:0:8450:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e659d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853109.132133:0:8450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e659d lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853109.132178:0:8450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787853109.132230:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f491e971450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+34:2363:x1874699526112512:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 211us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853109.132249:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 38 00010000:00010000:2.0:1787853109.132389:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e659d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853109.132396:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e659d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787853109.132415:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787853109.132617:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8a00/0x710df789068e6596 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793896c0 expref: 35 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853109.132633:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e659d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793896c0 expref: 34 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853109.132641:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f4910f92b00) 00010000:00010000:2.0:1787853109.132644:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787853109.132646:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49415b8c00, rc 0) 00000100:00100000:2.0:1787853109.132673:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49415a6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+34:10379:x1874699526112384:12345-192.168.204.1@tcp:101:dd.0 Request processed in 17134us (17608us total) trans 4294967333 rc 0/0 00000100:00100000:2.0:1787853109.132680:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 51 00000100:00100000:3.0:1787853109.138112:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853109.138220:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526112768 00000100:00100000:1.0:1787853109.138230:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526112768 00000100:00100000:1.0:1787853109.138314:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 52 00000100:00100000:1.0:1787853109.138325:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493c5fc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+34:10379:x1874699526112768:12345-192.168.204.1@tcp:36:dd.0 00010000:00010000:1.0:1787853109.138638:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e65ab lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853109.138656:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e65ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853109.138669:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e65ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787853109.138888:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:1.0:1787853109.138915:0:5837:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e338d73e reply state 00000000a67666df transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e65ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853109.138925:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787853109.139037:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493c5fc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+37:10379:x1874699526112768:12345-192.168.204.1@tcp:36:dd.0 Request processed in 713us (934us total) trans 4294967335 rc 0/0 00000100:00100000:1.0:1787853109.139045:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 52 00000020:00080000:1.0:1787853109.139051:0:5837:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787853109.141566:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e65ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853109.141623:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e65ab lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853109.141655:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e65ab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853109.141662:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f492a8ad200 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:2.0:1787853109.141667:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e65ab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853109.141675:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e65ab lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853109.141694:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f4910f92b00) 00010000:00010000:2.0:1787853109.141698:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787853109.141716:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e65ab lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853109.141723:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e65ab lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853109.586328:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853109.586858:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526112896 00000100:00100000:0.0:1787853109.586869:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526112896 00000100:00100000:0.0:1787853109.587036:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 53 00000100:00100000:0.0:1787853109.587045:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493c5fd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+36:10393:x1874699526112896:12345-192.168.204.1@tcp:101:stat.0 00010000:00010000:0.0:1787853109.587069:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853109.587091:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e65b2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c50793896c7 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853109.587182:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7400/0x710df789068e65b9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853109.587197:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7400/0x710df789068e65b9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853109.587225:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7400/0x710df789068e65b9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853109.587240:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e65c0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853109.587248:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e65c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853109.587255:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e65c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853109.587348:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6800/0x710df789068e65c7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853109.588863:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e659d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793896c0 expref: 37 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853109.589435:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6800/0x710df789068e65c7 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853109.589492:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e659d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793896c0 expref: 37 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853109.589510:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e659d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793896c0 expref: 37 pid: 5838 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853109.589526:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f492eb752c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5836:1874699552362880:192.168.204.1@tcp:104: 00000100:00100000:0.0:1787853109.589751:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f49419c4300 going to sleep for 11 seconds 00000100:00100000:0.0:1787853109.619617:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f492eb752c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5836:1874699552362880:192.168.204.1@tcp:104: 00010000:00010000:0.0:1787853109.619649:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6800/0x710df789068e65c7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853109.620641:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853109.620736:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526113152 00000100:00100000:2.0:1787853109.620744:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526113152 00000100:00100000:2.0:1787853109.620808:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 13 00000100:00100000:2.0:1787853109.620817:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49415a5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+38:5606:x1874699526113152:12345-192.168.204.1@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787853109.621235:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49415a5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+39:5606:x1874699526113152:12345-192.168.204.1@tcp:35:ldlm_bl.0 Request processed in 418us (598us total) trans 4294967336 rc 0/0 00000100:00100000:2.0:1787853109.621243:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 13 00000100:00100000:3.0:1787853109.628617:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853109.628856:0:11175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526113280 00000100:00100000:2.0:1787853109.628865:0:11175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526113280 00010000:00010000:2.0:1787853109.629192:0:11175:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e659d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793896c0 expref: 39 pid: 5838 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853109.629256:0:11175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 39 00000100:00100000:2.0:1787853109.629265:0:11175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493c5ff840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b1d98f5a-0be0-4f69-83a6-833c935c8205+39:2362:x1874699526113280:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787853109.629281:0:11175:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787853109.629289:0:11175:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e659d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793896c0 expref: 39 pid: 5838 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853109.629302:0:11175:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e659d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793896c0 expref: 39 pid: 5838 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853109.629325:0:11175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e659d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793896c0 expref: 39 pid: 5838 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853109.629341:0:11175:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f4910f92b00) 00010000:00010000:2.0:1787853109.629347:0:11175:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6800/0x710df789068e65c7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853109.629355:0:11175:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6800/0x710df789068e65c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853109.629375:0:11175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6800/0x710df789068e65c7 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853109.629403:0:11175:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787853109.629533:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6800/0x710df789068e65c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853109.629540:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6800/0x710df789068e65c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787853109.629611:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1787853109.629616:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787853109.629661:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6800/0x710df789068e65c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853109.629676:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6800/0x710df789068e65c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853109.629685:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7400/0x710df789068e65b9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853109.629691:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7400/0x710df789068e65b9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853109.629697:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7400/0x710df789068e65b9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853109.629714:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b7400 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:0.0:1787853109.629718:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7400/0x710df789068e65b9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853109.629725:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7400/0x710df789068e65b9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853109.629742:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8f491176b400) 00010000:00010000:0.0:1787853109.629745:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787853109.629748:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7400/0x710df789068e65b9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853109.629754:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7400/0x710df789068e65b9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853109.629777:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e65c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853109.629783:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e65c0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853109.629788:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e65c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853109.629793:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b6200 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:0.0:1787853109.629796:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e65c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853109.629802:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e65c0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853109.629809:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8f491176bd00) 00010000:00010000:0.0:1787853109.629811:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787853109.629814:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e65c0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853109.629820:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e65c0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853109.629871:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e65b2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793896c7 expref: 39 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853109.629885:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6800/0x710df789068e65c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793896c7 expref: 38 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853109.629892:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f4910f92b00) 00010000:00010000:0.0:1787853109.629894:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787853109.629896:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49415b6800, rc 0) 00000100:00100000:2.0:1787853109.632564:0:11175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493c5ff840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b1d98f5a-0be0-4f69-83a6-833c935c8205+38:2362:x1874699526113280:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 3286us (3942us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853109.632593:0:11175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 39 00000100:00100000:0.0:1787853109.633294:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493c5fd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+37:10393:x1874699526112896:12345-192.168.204.1@tcp:101:stat.0 Request processed in 46245us (46970us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853109.633303:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 53 00000100:00100000:1.0:1787853109.743627:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853109.746057:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526113536 00000100:00100000:0.0:1787853109.746072:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526113536 00000100:00100000:0.0:1787853109.746168:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 54 00000100:00100000:0.0:1787853109.746179:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49415a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+37:10399:x1874699526113536:12345-192.168.204.1@tcp:36:truncate.0 00010000:00010000:0.0:1787853109.746239:0:8462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787853109.746266:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6800/0x710df789068e65c7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793896c7 expref: 37 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853109.746290:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f4910f92b00) 00010000:00010000:0.0:1787853109.746295:0:8462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787853109.746545:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e65ce lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853109.746559:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e65ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853109.746672:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e65ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787853109.746730:0:8462:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:0.0:1787853109.746754:0:8462:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000061f05d54 reply state 00000000aa4498e0 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e65ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853109.746764:0:8462:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787853109.746877:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49415a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+39:10399:x1874699526113536:12345-192.168.204.1@tcp:36:truncate.0 Request processed in 699us (3309us total) trans 4294967338 rc 0/0 00000100:00100000:0.0:1787853109.746885:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 54 00000020:00080000:0.0:1787853109.746890:0:8462:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787853109.751933:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e65ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853109.751952:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e65ce lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853109.751960:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e65ce lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853109.751965:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b7c00 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:0.0:1787853109.751970:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e65ce lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853109.751978:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e65ce lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853109.751999:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f4910f92b00) 00010000:00010000:0.0:1787853109.752003:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787853109.752025:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e65ce lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853109.752032:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e65ce lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853109.960329:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853109.960616:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526113664 00000100:00100000:2.0:1787853109.960655:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526113664 00000100:00100000:2.0:1787853109.960735:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 55 00000100:00100000:2.0:1787853109.960746:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49415a6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+38:10413:x1874699526113664:12345-192.168.204.1@tcp:101:stat.0 00010000:00010000:2.0:1787853109.960771:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853109.960792:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8a00/0x710df789068e65d5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c50793896ce expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853109.960867:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9600/0x710df789068e65dc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853109.960887:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9600/0x710df789068e65dc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853109.960899:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9600/0x710df789068e65dc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853109.960915:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8600/0x710df789068e65e3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853109.960923:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8600/0x710df789068e65e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853109.960929:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8600/0x710df789068e65e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853109.961035:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8000/0x710df789068e65ea lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853109.961043:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8000/0x710df789068e65ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853109.961050:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8000/0x710df789068e65ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787853109.961092:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:2.0:1787853109.961096:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787853109.961120:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8000/0x710df789068e65ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853109.961132:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8000/0x710df789068e65ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853109.961141:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9600/0x710df789068e65dc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853109.961161:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9600/0x710df789068e65dc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853109.961169:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9600/0x710df789068e65dc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853109.961175:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b9600 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:2.0:1787853109.961180:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9600/0x710df789068e65dc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853109.961188:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9600/0x710df789068e65dc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853109.961203:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8f491176b400) 00010000:00010000:2.0:1787853109.961207:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787853109.961213:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9600/0x710df789068e65dc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853109.961219:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9600/0x710df789068e65dc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853109.961243:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8600/0x710df789068e65e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853109.961249:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8600/0x710df789068e65e3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853109.961254:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8600/0x710df789068e65e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853109.961259:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b8600 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:2.0:1787853109.961262:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8600/0x710df789068e65e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853109.961268:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8600/0x710df789068e65e3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853109.961276:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8f4910aab300) 00010000:00010000:2.0:1787853109.961278:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787853109.961281:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8600/0x710df789068e65e3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853109.961286:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8600/0x710df789068e65e3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853109.961318:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8a00/0x710df789068e65d5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793896ce expref: 40 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853109.961330:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8000/0x710df789068e65ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793896ce expref: 39 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853109.961384:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f4910f92b00) 00010000:00010000:2.0:1787853109.961386:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787853109.961389:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49415b8000, rc 0) 00000100:00100000:2.0:1787853109.961671:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49415a6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+39:10413:x1874699526113664:12345-192.168.204.1@tcp:101:stat.0 Request processed in 928us (1352us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853109.961679:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 55 00000100:00100000:1.0:1787853110.059451:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853110.059543:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526113920 00000100:00100000:3.0:1787853110.059555:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526113920 00000100:00100000:3.0:1787853110.059649:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 56 00000100:00100000:3.0:1787853110.059660:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49415a4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+39:10423:x1874699526113920:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:3.0:1787853110.059682:0:8462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853110.059713:0:8462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21800/0x710df789068e65f1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c50793896d5 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787853110.059841:0:8462:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:3.0:1787853110.059974:0:8462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21800/0x710df789068e65f1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793896d5 expref: 41 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853110.059989:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f491176be00) 00010000:00010000:3.0:1787853110.059992:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787853110.059997:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21800/0x710df789068e65f1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793896d5 expref: 41 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853110.060013:0:8462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4921e21800, rc 0) 00000100:00100000:3.0:1787853110.060198:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49415a4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+40:10423:x1874699526113920:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 539us (756us total) trans 4294967339 rc 301/301 00000100:00100000:3.0:1787853110.060206:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 56 00010000:00010000:0.0:1787853110.064527:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787853110.067383:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853110.067476:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526114176 00000100:00100000:1.0:1787853110.067485:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526114176 00000100:00100000:1.0:1787853110.067547:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 14 00000100:00100000:1.0:1787853110.067556:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4941af21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+40:10423:x1874699526114176:12345-192.168.204.1@tcp:35:lfs.0 00000100:00100000:1.0:1787853110.068467:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4941af21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+41:10423:x1874699526114176:12345-192.168.204.1@tcp:35:lfs.0 Request processed in 909us (1091us total) trans 4294967340 rc 0/0 00000100:00100000:1.0:1787853110.068491:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 14 00000100:00100000:2.0:1787853110.204997:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853110.205109:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526114432 00000100:00100000:0.0:1787853110.205120:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526114432 00000100:00100000:0.0:1787853110.205201:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 57 00000100:00100000:0.0:1787853110.205211:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4941af0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+41:10429:x1874699526114432:12345-192.168.204.1@tcp:101:bash.0 00010000:00010000:0.0:1787853110.205235:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853110.205256:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e65ff lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c50793896dc expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853110.205361:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6800/0x710df789068e6606 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853110.205378:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8000/0x710df789068e65ea lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793896ce expref: 42 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853110.205388:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6800/0x710df789068e6606 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853110.205424:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8000/0x710df789068e65ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793896ce expref: 42 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853110.205438:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8000/0x710df789068e65ea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793896ce expref: 42 pid: 5838 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853110.205451:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f492eb752c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5836:1874699552363008:192.168.204.1@tcp:104: 00000100:00100000:0.0:1787853110.205567:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f49419c4900 going to sleep for 11 seconds 00000100:00100000:2.0:1787853110.213128:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853110.213303:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526114560 00000100:00100000:3.0:1787853110.213330:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526114560 00010000:00010000:3.0:1787853110.213376:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8000/0x710df789068e65ea lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793896ce expref: 43 pid: 5838 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853110.213425:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 40 00000100:00100000:3.0:1787853110.213437:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4941af3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+43:2363:x1874699526114560:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787853110.213455:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787853110.213463:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8000/0x710df789068e65ea lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793896ce expref: 43 pid: 5838 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853110.213478:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8000/0x710df789068e65ea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793896ce expref: 43 pid: 5838 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853110.213503:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f4910f92b00) 00010000:00010000:3.0:1787853110.213509:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6800/0x710df789068e6606 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853110.213518:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6800/0x710df789068e6606 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853110.213526:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6800/0x710df789068e6606 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853110.213545:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787853110.213648:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4941af3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+43:2363:x1874699526114560:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 213us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853110.213655:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 40 00010000:00010000:0.0:1787853110.215058:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8000/0x710df789068e65ea lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793896ce expref: 42 pid: 5838 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853110.215164:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f492eb752c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5836:1874699552363008:192.168.204.1@tcp:104: 00010000:00010000:0.0:1787853110.215189:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6800/0x710df789068e6606 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853110.215200:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6800/0x710df789068e6606 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853110.215207:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6800/0x710df789068e6606 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787853110.215230:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:0.0:1787853110.215404:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e65ff lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793896dc expref: 43 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853110.215423:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6800/0x710df789068e6606 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793896dc expref: 42 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853110.215432:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f4910f92b00) 00010000:00010000:0.0:1787853110.215435:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787853110.215438:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49415b6800, rc 0) 00000100:00100000:0.0:1787853110.215563:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4941af0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+42:10429:x1874699526114432:12345-192.168.204.1@tcp:101:bash.0 Request processed in 10352us (10575us total) trans 4294967341 rc 0/0 00000100:00100000:0.0:1787853110.215625:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 57 00000100:00100000:3.0:1787853110.220397:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853110.220499:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526114816 00000100:00100000:0.0:1787853110.220526:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526114816 00000100:00100000:0.0:1787853110.220605:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 58 00000100:00100000:0.0:1787853110.220615:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493c5fc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+42:10429:x1874699526114816:12345-192.168.204.1@tcp:36:bash.0 00010000:00010000:0.0:1787853110.220912:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e6614 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853110.220931:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e6614 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853110.220942:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e6614 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787853110.220995:0:8462:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:0.0:1787853110.221019:0:8462:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a840c5ff reply state 000000003085f36c transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e6614 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853110.221028:0:8462:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787853110.221262:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493c5fc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+45:10429:x1874699526114816:12345-192.168.204.1@tcp:36:bash.0 Request processed in 647us (873us total) trans 4294967343 rc 0/0 00000100:00100000:0.0:1787853110.221270:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 58 00000020:00080000:0.0:1787853110.221275:0:8462:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787853110.223280:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e6614 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853110.223297:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e6614 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853110.223304:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e6614 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853110.223310:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b6200 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:0.0:1787853110.223314:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e6614 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853110.223338:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e6614 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853110.223355:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f4910f92b00) 00010000:00010000:0.0:1787853110.223358:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787853110.223362:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e6614 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853110.223368:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e6614 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853110.229931:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853110.230356:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526114944 00000100:00100000:3.0:1787853110.230379:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526114944 00000100:00100000:3.0:1787853110.230432:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 59 00000100:00100000:3.0:1787853110.230441:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4941af0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+44:10429:x1874699526114944:12345-192.168.204.1@tcp:101:bash.0 00010000:00010000:3.0:1787853110.230464:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853110.230483:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21800/0x710df789068e661b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c50793896e3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853110.230554:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e6622 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853110.230607:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6800/0x710df789068e6606 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793896dc expref: 45 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853110.230617:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e6622 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853110.230649:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6800/0x710df789068e6606 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793896dc expref: 45 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853110.230662:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6800/0x710df789068e6606 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793896dc expref: 45 pid: 5836 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853110.230676:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f493c5fcf00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5838:1874699552363136:192.168.204.1@tcp:104: 00000100:00100000:3.0:1787853110.230746:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f4902db4480 going to sleep for 11 seconds 00000100:00100000:3.0:1787853110.234863:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853110.234964:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526115072 00000100:00100000:0.0:1787853110.234974:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526115072 00010000:00010000:0.0:1787853110.235013:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6800/0x710df789068e6606 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793896dc expref: 46 pid: 5836 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853110.235053:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 41 00000100:00100000:0.0:1787853110.235063:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493c5fda40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+46:2362:x1874699526115072:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787853110.235090:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787853110.235098:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6800/0x710df789068e6606 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793896dc expref: 46 pid: 5836 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853110.235112:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6800/0x710df789068e6606 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793896dc expref: 46 pid: 5836 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853110.235137:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f4910f92b00) 00010000:00010000:0.0:1787853110.235154:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e6622 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853110.235182:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e6622 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853110.235191:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e6622 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853110.235216:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787853110.235277:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493c5fda40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+46:2362:x1874699526115072:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 216us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853110.235285:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 41 00010000:00010000:2.0:1787853110.236204:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6800/0x710df789068e6606 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793896dc expref: 45 pid: 5836 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853110.236225:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f493c5fcf00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5838:1874699552363136:192.168.204.1@tcp:104: 00010000:00010000:2.0:1787853110.236247:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e6622 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853110.236256:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e6622 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853110.236263:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e6622 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787853110.236307:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1787853110.236311:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787853110.236332:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e6622 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853110.236382:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21800/0x710df789068e661b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793896e3 expref: 45 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853110.236397:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e6622 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793896e3 expref: 44 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853110.236406:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f4910f92b00) 00010000:00010000:2.0:1787853110.236409:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787853110.236412:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4921e20000, rc 0) 00000100:00100000:2.0:1787853110.236466:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4941af0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+44:10429:x1874699526114944:12345-192.168.204.1@tcp:101:bash.0 Request processed in 6026us (6558us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853110.236473:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 59 00000100:00100000:2.0:1787853110.243190:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853110.243323:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526115328 00000100:00100000:1.0:1787853110.243335:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526115328 00000100:00100000:1.0:1787853110.243398:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 15 00000100:00100000:1.0:1787853110.243409:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f491040a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+44:10429:x1874699526115328:12345-192.168.204.1@tcp:35:bash.0 00000100:00100000:1.0:1787853110.243684:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f491040a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+45:10429:x1874699526115328:12345-192.168.204.1@tcp:35:bash.0 Request processed in 277us (504us total) trans 4294967344 rc 0/0 00000100:00100000:1.0:1787853110.243692:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 15 00000100:00100000:1.0:1787853110.379964:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853110.380073:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526115584 00000100:00100000:0.0:1787853110.380083:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526115584 00000100:00100000:0.0:1787853110.380159:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 60 00000100:00100000:0.0:1787853110.380169:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49415a7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+45:10439:x1874699526115584:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:0.0:1787853110.380197:0:8462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853110.380220:0:8462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e6629 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c50793896ea expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787853110.380337:0:8462:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:0.0:1787853110.380458:0:8462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e6629 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793896ea expref: 47 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853110.380472:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f491176be00) 00010000:00010000:0.0:1787853110.380475:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787853110.380479:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e6629 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793896ea expref: 47 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853110.380495:0:8462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49415b6200, rc 0) 00000100:00100000:0.0:1787853110.380639:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49415a7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+46:10439:x1874699526115584:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 470us (683us total) trans 4294967345 rc 301/301 00000100:00100000:0.0:1787853110.380648:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 60 00000100:00100000:2.0:1787853110.387200:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853110.387292:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526115712 00000100:00100000:0.0:1787853110.387301:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526115712 00000100:00100000:0.0:1787853110.387396:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 61 00000100:00100000:0.0:1787853110.387407:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4941af03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+46:10439:x1874699526115712:12345-192.168.204.1@tcp:34:lfs.0 00010000:00010000:0.0:1787853110.387487:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e6637 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853110.387511:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e6637 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853110.387524:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e6637 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853110.387537:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e663e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853110.387543:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e663e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853110.387549:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e663e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853110.387661:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7400/0x710df789068e6645 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853110.387669:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7400/0x710df789068e6645 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853110.387675:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7400/0x710df789068e6645 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787853110.387744:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7400/0x710df789068e6645 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853110.387758:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e6637 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853110.387764:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e6637 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853110.387771:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e6637 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853110.387778:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b6200 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:0.0:1787853110.387782:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e6637 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853110.387790:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e6637 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853110.387802:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8f491176b400) 00010000:00010000:0.0:1787853110.387805:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787853110.387813:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e6637 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853110.387822:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e6637 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853110.387839:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e663e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853110.387844:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e663e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853110.387858:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e663e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853110.387863:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b7c00 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:0.0:1787853110.387866:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e663e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853110.387872:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e663e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853110.387879:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8f491176bd00) 00010000:00010000:0.0:1787853110.387882:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787853110.387884:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e663e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853110.387889:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e663e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853110.387904:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7400/0x710df789068e6645 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853110.387910:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7400/0x710df789068e6645 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853110.387916:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7400/0x710df789068e6645 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853110.387921:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b7400 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:0.0:1787853110.387924:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7400/0x710df789068e6645 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853110.387940:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7400/0x710df789068e6645 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853110.387949:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f4910f92b00) 00010000:00010000:0.0:1787853110.387951:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787853110.387954:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7400/0x710df789068e6645 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853110.387959:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7400/0x710df789068e6645 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853110.388123:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4941af03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+46:10439:x1874699526115712:12345-192.168.204.1@tcp:34:lfs.0 Request processed in 717us (931us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853110.388132:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 61 00000100:00100000:2.0:1787853110.403641:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853110.404079:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526115968 00000100:00100000:1.0:1787853110.404088:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526115968 00000100:00100000:1.0:1787853110.404210:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 16 00000100:00100000:1.0:1787853110.404222:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4941af21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+46:10439:x1874699526115968:12345-192.168.204.1@tcp:35:lfs.0 00000100:00100000:1.0:1787853110.404488:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4941af21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+47:10439:x1874699526115968:12345-192.168.204.1@tcp:35:lfs.0 Request processed in 268us (856us total) trans 4294967346 rc 0/0 00000100:00100000:1.0:1787853110.404496:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 16 00000100:00100000:1.0:1787853110.485985:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853110.486093:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526116224 00000100:00100000:0.0:1787853110.486103:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526116224 00000100:00100000:0.0:1787853110.486176:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 62 00000100:00100000:0.0:1787853110.486187:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49415a5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+47:10442:x1874699526116224:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:0.0:1787853110.486212:0:8462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853110.486231:0:8462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7400/0x710df789068e664c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c50793896f1 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853110.486303:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e6653 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853110.486317:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e6653 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853110.486329:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e6653 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853110.486367:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e665a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853110.486374:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e665a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853110.486381:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e665a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853110.486507:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7600/0x710df789068e6661 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853110.486516:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7600/0x710df789068e6661 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853110.486523:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7600/0x710df789068e6661 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787853110.486532:0:8462:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1787853110.486670:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e6653 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853110.486678:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e6653 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853110.486685:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e6653 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853110.486691:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b7c00 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:0.0:1787853110.486695:0:8462:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e6653 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853110.486718:0:8462:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e6653 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853110.486731:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8f491176b400) 00010000:00010000:0.0:1787853110.486734:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787853110.486739:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e6653 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853110.486817:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e6653 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853110.486836:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e665a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853110.486842:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e665a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853110.486847:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e665a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853110.486852:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b6200 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:0.0:1787853110.486855:0:8462:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e665a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853110.486862:0:8462:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e665a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853110.486869:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8f491176bd00) 00010000:00010000:0.0:1787853110.486872:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787853110.486874:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e665a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853110.486889:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e665a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853110.486933:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7400/0x710df789068e664c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793896f1 expref: 50 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853110.486946:0:8462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7600/0x710df789068e6661 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793896f1 expref: 49 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853110.486954:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f4910f92b00) 00010000:00010000:0.0:1787853110.486956:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787853110.486959:0:8462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49415b7600, rc 0) 00000100:00100000:0.0:1787853110.487021:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49415a5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+49:10442:x1874699526116224:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 837us (1046us total) trans 4294967347 rc 0/0 00000100:00100000:0.0:1787853110.487029:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 62 00000100:00100000:2.0:1787853110.495174:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853110.496410:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526116352 00000100:00100000:3.0:1787853110.496424:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526116352 00000100:00100000:3.0:1787853110.496497:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 63 00000100:00100000:3.0:1787853110.496508:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49216e52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+49:10442:x1874699526116352:12345-192.168.204.1@tcp:54:lfs.0 00010000:00010000:3.0:1787853110.496629:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20a00/0x710df789068e666f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853110.496645:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20a00/0x710df789068e666f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853110.496657:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20a00/0x710df789068e666f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853110.496695:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20a00/0x710df789068e666f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853110.496703:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20a00/0x710df789068e666f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853110.496709:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20a00/0x710df789068e666f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853110.496715:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4921e20a00 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:3.0:1787853110.496720:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20a00/0x710df789068e666f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853110.496727:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20a00/0x710df789068e666f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853110.496816:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f4910f92b00) 00010000:00010000:3.0:1787853110.496820:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787853110.496826:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20a00/0x710df789068e666f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853110.496833:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20a00/0x710df789068e666f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853110.497108:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49216e52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+49:10442:x1874699526116352:12345-192.168.204.1@tcp:54:lfs.0 Request processed in 600us (1942us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853110.497117:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 63 00000100:00100000:2.0:1787853110.502849:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853110.503073:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853110.503156:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526116736 00000100:00100000:3.0:1787853110.503167:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526116736 00000100:00100000:3.0:1787853110.503228:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 17 00000100:00100000:3.0:1787853110.503240:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49031c30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+49:10442:x1874699526116736:12345-192.168.204.1@tcp:35:lfs.0 00000100:00100000:3.0:1787853110.503481:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49031c30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+50:10442:x1874699526116736:12345-192.168.204.1@tcp:35:lfs.0 Request processed in 243us (407us total) trans 4294967348 rc 0/0 00000100:00100000:3.0:1787853110.503490:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 17 00000100:00100000:0.0:1787853110.506655:0:11175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526116480 00000100:00100000:0.0:1787853110.506670:0:11175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526116480 00000100:00100000:0.0:1787853110.506759:0:11175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 3 00000100:00100000:0.0:1787853110.506770:0:11175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49216e6d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b1d98f5a-0be0-4f69-83a6-833c935c8205+50:2363:x1874699526116480:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787853110.506787:0:11175:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787853110.506814:0:11175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7600/0x710df789068e6661 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793896f1 expref: 50 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853110.506837:0:11175:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f4910f92b00) 00010000:00010000:0.0:1787853110.506843:0:11175:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787853110.507185:0:11175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49216e6d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b1d98f5a-0be0-4f69-83a6-833c935c8205+49:2363:x1874699526116480:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 415us (4345us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853110.507208:0:11175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 3 00000100:00100000:2.0:1787853110.726419:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853110.726524:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526116992 00000100:00100000:0.0:1787853110.726535:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526116992 00000100:00100000:0.0:1787853110.726633:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 64 00000100:00100000:0.0:1787853110.726644:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49031c3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+49:10460:x1874699526116992:12345-192.168.204.1@tcp:101:cat.0 00010000:00010000:0.0:1787853110.726675:0:8462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853110.726699:0:8462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7600/0x710df789068e6676 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c50793896f8 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853110.726851:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7400/0x710df789068e667d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853110.726869:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7400/0x710df789068e667d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853110.726882:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7400/0x710df789068e667d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787853110.726894:0:8462:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1787853110.727039:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7600/0x710df789068e6676 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793896f8 expref: 52 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853110.727062:0:8462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7400/0x710df789068e667d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793896f8 expref: 51 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853110.727070:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f4910f92b00) 00010000:00010000:0.0:1787853110.727074:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787853110.727077:0:8462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49415b7400, rc 0) 00000100:00100000:0.0:1787853110.727177:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49031c3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+51:10460:x1874699526116992:12345-192.168.204.1@tcp:101:cat.0 Request processed in 535us (771us total) trans 4294967349 rc 0/0 00000100:00100000:0.0:1787853110.727187:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 64 00000100:00100000:1.0:1787853110.774890:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853110.775108:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526117120 00000100:00100000:0.0:1787853110.775120:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526117120 00000100:00100000:0.0:1787853110.775199:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 65 00000100:00100000:0.0:1787853110.775210:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49415a6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+51:10461:x1874699526117120:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:0.0:1787853110.775242:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853110.775443:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7600/0x710df789068e668b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c50793896ff expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853110.775520:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e6692 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853110.775535:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e6692 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853110.775548:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e6692 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787853110.775649:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:0.0:1787853110.775653:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787853110.775675:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e6692 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853110.775704:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7600/0x710df789068e668b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793896ff expref: 53 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853110.775727:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e6692 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793896ff expref: 52 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853110.775826:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8f491176b400) 00010000:00010000:0.0:1787853110.775829:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787853110.775833:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49415b6200, rc 0) 00000100:00100000:0.0:1787853110.776019:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49415a6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+52:10461:x1874699526117120:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 810us (1147us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853110.776027:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 65 00000100:00100000:1.0:1787853110.783464:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853110.783559:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526117504 00000100:00100000:3.0:1787853110.783620:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526117504 00000100:00100000:3.0:1787853110.783705:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 18 00000100:00100000:3.0:1787853110.783717:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49415a52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+52:10461:x1874699526117504:12345-192.168.204.1@tcp:35:lfs.0 00000100:00100000:3.0:1787853110.784416:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49415a52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+53:10461:x1874699526117504:12345-192.168.204.1@tcp:35:lfs.0 Request processed in 699us (964us total) trans 4294967350 rc 0/0 00000100:00100000:3.0:1787853110.784428:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 18 00000100:00100000:2.0:1787853110.788103:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853110.788224:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526117632 00000100:00100000:3.0:1787853110.788235:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526117632 00000100:00100000:3.0:1787853110.788430:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 4 00000100:00100000:3.0:1787853110.788442:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49031c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+53:10461:x1874699526117632:12345-192.168.204.1@tcp:103:lfs.0 00010000:00010000:3.0:1787853110.788462:0:8450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787853110.788493:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e6622 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793896e3 expref: 53 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853110.788540:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7400/0x710df789068e667d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793896f8 expref: 52 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853110.788553:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e652d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793896a4 expref: 51 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853110.788562:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f4910f92b00) 00010000:00010000:3.0:1787853110.788619:0:8450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787853110.788682:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49031c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+50:10461:x1874699526117632:12345-192.168.204.1@tcp:103:lfs.0 Request processed in 242us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853110.788690:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 4 00000100:00100000:2.0:1787853110.792001:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853110.792105:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526117760 00000100:00100000:0.0:1787853110.792119:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526117760 00000100:00100000:0.0:1787853110.792236:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 66 00000100:00100000:0.0:1787853110.792259:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49031c1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+50:10461:x1874699526117760:12345-192.168.204.1@tcp:58:lfs.0 00010000:00010000:0.0:1787853110.792411:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7600/0x710df789068e6699 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853110.792428:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7600/0x710df789068e6699 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853110.792440:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7600/0x710df789068e6699 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787853110.792884:0:8462:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787853110.793083:0:8462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:0.0:1787853110.793172:0:8462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:0.0:1787853110.793966:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49031c1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+50:10461:x1874699526117760:12345-192.168.204.1@tcp:58:lfs.0 Request processed in 1712us (1972us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853110.793978:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 66 00000100:00100000:2.0:1787853110.832443:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853110.832541:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526117888 00000100:00100000:3.0:1787853110.832551:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526117888 00000100:00100000:3.0:1787853110.832648:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 67 00000100:00100000:3.0:1787853110.832659:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49031c2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+50:10463:x1874699526117888:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:3.0:1787853110.832681:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853110.832702:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e66a0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c5079389706 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853110.832845:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e66a7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853110.832860:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e66a7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853110.832872:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e66a7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853110.833326:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20a00/0x710df789068e66ae lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853110.833336:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20a00/0x710df789068e66ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853110.833344:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20a00/0x710df789068e66ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853110.833444:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21c00/0x710df789068e66b5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853110.833453:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21c00/0x710df789068e66b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853110.833460:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21c00/0x710df789068e66b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787853110.833495:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1787853110.833500:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787853110.833518:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21c00/0x710df789068e66b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853110.833531:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21c00/0x710df789068e66b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853110.833539:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e66a7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853110.833545:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e66a7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853110.833564:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e66a7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853110.833603:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4921e20000 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:3.0:1787853110.833607:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e66a7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853110.833615:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e66a7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853110.833627:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8f491176b400) 00010000:00010000:3.0:1787853110.833630:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787853110.833635:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e66a7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853110.833641:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e66a7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853110.833655:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20a00/0x710df789068e66ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853110.833661:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20a00/0x710df789068e66ae lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853110.833665:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20a00/0x710df789068e66ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853110.833669:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4921e20a00 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:3.0:1787853110.833671:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20a00/0x710df789068e66ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853110.833688:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20a00/0x710df789068e66ae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853110.833695:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8f4910f92b00) 00010000:00010000:3.0:1787853110.833697:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787853110.833700:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20a00/0x710df789068e66ae lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853110.833706:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20a00/0x710df789068e66ae lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853110.834837:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e66a0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389706 expref: 52 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853110.834864:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21c00/0x710df789068e66b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389706 expref: 51 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853110.834881:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f491176bd00) 00010000:00010000:3.0:1787853110.834883:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787853110.834886:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4921e21c00, rc 0) 00000100:00100000:2.0:1787853110.835120:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49031c2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+51:10463:x1874699526117888:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 2460us (2683us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853110.835140:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 67 00000100:00100000:3.0:1787853111.018160:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f493c5fd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552363520:0@lo:400:kworker.0 00000100:00100000:3.0:1787853111.018245:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853111.018327:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787853111.018334:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f493c5ff0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1874699552363648:0@lo:400:kworker.0 00000100:00100000:3.0:1787853111.018365:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853111.018409:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552363520 00000100:00100000:3.0:1787853111.018416:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552363520 00000100:00100000:3.0:1787853111.018477:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787853111.018498:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49418a0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874699552363520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853111.018558:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49418a0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874699552363520:12345-0@lo:400:kworker.0 Request processed in 62us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853111.018566:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:3.0:1787853111.018618:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787853111.018656:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f493c5fd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552363520:0@lo:400:kworker.0 00000100:00100000:3.0:1787853111.018697:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552363648 00000100:00100000:3.0:1787853111.018701:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552363648 00000100:00100000:1.0:1787853111.021446:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f493c5fed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874699552363392:0@lo:400:kworker.0 00000100:00100000:1.0:1787853111.021525:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853111.021589:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f493c5ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5d48a955-7010-4118-9c7d-f396984ae1ff:3308:1874699552363264:0@lo:400:kworker.0 00000100:00100000:2.0:1787853111.021640:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853111.021703:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f493c5fe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1874699552363776:0@lo:400:kworker.0 00000100:00100000:1.0:1787853111.022997:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f493c5fcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874699552363904:0@lo:400:kworker.0 00000100:00100000:1.0:1787853111.023041:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:1.0:1787853111.023211:0:11690:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787853111.023215:0:11690:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787853111.023265:0:11690:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1787853111.023271:0:11690:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787853111.023976:0:11690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f493bee9e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11690:1874699552364032:192.168.204.1@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787853111.024050:0:11690:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f49063f7840 going to sleep for 11 seconds 00000100:00100000:1.0:1787853111.024077:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552363264 00000100:00100000:1.0:1787853111.024084:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552363264 00000100:00100000:1.0:1787853111.024149:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1787853111.024158:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4906230850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+19:3308:x1874699552363264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853111.024213:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4906230850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+19:3308:x1874699552363264:12345-0@lo:400:kworker.0 Request processed in 57us (2573us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853111.024220:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1787853111.024250:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552363392 00000100:00100000:1.0:1787853111.024254:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552363392 00000100:00100000:1.0:1787853111.025822:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787853111.025843:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4910d13840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874699552363648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853111.025935:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4910d13840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874699552363648:12345-0@lo:400:kworker.0 Request processed in 101us (7569us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853111.025943:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787853111.025971:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1787853111.025976:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49415a70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874699552363392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853111.026010:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49415a70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874699552363392:12345-0@lo:400:kworker.0 Request processed in 33us (4485us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853111.026016:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1787853111.026045:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552363904 00000100:00100000:1.0:1787853111.026052:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552363904 00000100:00100000:1.0:1787853111.026087:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787853111.026093:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493beeb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3309:x1874699552363904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853111.026144:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493beeb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3309:x1874699552363904:12345-0@lo:400:kworker.0 Request processed in 51us (3102us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853111.026150:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787853111.026199:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f493c5fed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874699552363392:0@lo:400:kworker.0 00000100:00100000:1.0:1787853111.026210:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f493c5fcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874699552363904:0@lo:400:kworker.0 00000100:00100000:1.0:1787853111.026244:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f493c5ff0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1874699552363648:0@lo:400:kworker.0 00000100:00080000:2.0:1787853111.026352:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787853111.026357:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787853111.026372:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853111.026412:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f493c5ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5d48a955-7010-4118-9c7d-f396984ae1ff:3308:1874699552363264:0@lo:400:kworker.0 00000100:00100000:2.0:1787853111.026427:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552363776 00000100:00100000:2.0:1787853111.026430:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552363776 00000100:00100000:2.0:1787853111.026453:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1787853111.026458:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493fd57840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874699552363776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853111.026489:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493fd57840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874699552363776:12345-0@lo:400:kworker.0 Request processed in 30us (116us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853111.026495:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00080000:2.0:1787853111.026508:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787853111.026526:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f493c5fe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1874699552363776:0@lo:400:kworker.0 00000100:00100000:3.0:1787853111.035552:0:11690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f493bee9e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11690:1874699552364032:192.168.204.1@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787853111.042756:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853111.043249:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526118016 00000100:00100000:1.0:1787853111.043261:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526118016 00000100:00100000:1.0:1787853111.043381:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 1 00000100:00100000:1.0:1787853111.043392:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4910d103c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:b1d98f5a-0be0-4f69-83a6-833c935c8205+51:10474:x1874699526118016:12345-192.168.204.1@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1787853111.043478:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4910d103c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:b1d98f5a-0be0-4f69-83a6-833c935c8205+51:10474:x1874699526118016:12345-192.168.204.1@tcp:900:lhsmtool_posix.0 Request processed in 89us (734us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853111.043485:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 1 00000100:00080000:2.0:1787853111.043544:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787853111.059742:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853111.059936:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526118144 00000100:00100000:1.0:1787853111.059948:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526118144 00000100:00100000:1.0:1787853111.060011:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 68 00000100:00100000:1.0:1787853111.060021:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493c5fe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+51:10474:x1874699526118144:12345-192.168.204.1@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787853111.060058:0:5836:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787853111.060193:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493c5fe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+51:10474:x1874699526118144:12345-192.168.204.1@tcp:53:lhsmtool_posix.0 Request processed in 173us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853111.060201:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 68 00000100:00100000:0.0:1787853111.068997:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853111.069079:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526118272 00000100:00100000:2.0:1787853111.069089:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526118272 00000100:00100000:2.0:1787853111.069163:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 69 00000100:00100000:2.0:1787853111.069173:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f492eb75a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+51:10474:x1874699526118272:12345-192.168.204.1@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787853111.069248:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e66bc lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853111.069267:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e66bc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853111.069280:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e66bc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853111.069311:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9e00/0x710df789068e66c3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853111.069319:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9e00/0x710df789068e66c3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853111.069325:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9e00/0x710df789068e66c3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853111.069352:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8a00/0x710df789068e66ca lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853111.069361:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8a00/0x710df789068e66ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853111.069368:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8a00/0x710df789068e66ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787853111.069407:0:8462:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1787853111.069411:0:8462:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787853111.069424:0:8462:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8a00/0x710df789068e66ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853111.069436:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e66bc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853111.069443:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e66bc lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853111.069451:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e66bc lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853111.069469:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b8c00 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:2.0:1787853111.069474:0:8462:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e66bc lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853111.069483:0:8462:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e66bc lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853111.069496:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f4914d11600) 00010000:00010000:2.0:1787853111.069499:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787853111.069505:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e66bc lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853111.069513:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e66bc lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853111.069527:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9e00/0x710df789068e66c3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853111.069532:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9e00/0x710df789068e66c3 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853111.069552:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9e00/0x710df789068e66c3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853111.069558:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b9e00 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:2.0:1787853111.069561:0:8462:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9e00/0x710df789068e66c3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853111.069566:0:8462:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9e00/0x710df789068e66c3 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853111.069617:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff8f4910aab300) 00010000:00010000:2.0:1787853111.069619:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787853111.069623:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9e00/0x710df789068e66c3 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853111.069629:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9e00/0x710df789068e66c3 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853111.069645:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8a00/0x710df789068e66ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853111.069651:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8a00/0x710df789068e66ca lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853111.069657:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8a00/0x710df789068e66ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853111.069663:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b8a00 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:2.0:1787853111.069666:0:8462:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8a00/0x710df789068e66ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853111.069684:0:8462:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8a00/0x710df789068e66ca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853111.069692:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f491176bd00) 00010000:00010000:2.0:1787853111.069694:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787853111.069698:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8a00/0x710df789068e66ca lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853111.069704:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8a00/0x710df789068e66ca lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853111.069800:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f492eb75a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+51:10474:x1874699526118272:12345-192.168.204.1@tcp:34:lhsmtool_posix.0 Request processed in 628us (812us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853111.069809:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 69 00000100:00100000:0.0:1787853111.074623:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853111.074800:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526118528 00000100:00100000:2.0:1787853111.074811:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526118528 00000100:00100000:2.0:1787853111.074863:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 70 00000100:00100000:2.0:1787853111.074872:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f492eb75e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+51:10474:x1874699526118528:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787853111.074893:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853111.074912:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8600/0x710df789068e66d1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c507938970d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853111.075018:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8000/0x710df789068e66d8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853111.075035:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8000/0x710df789068e66d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853111.075048:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8000/0x710df789068e66d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787853111.075059:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1787853111.075166:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8000/0x710df789068e66d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853111.075174:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8000/0x710df789068e66d8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853111.075181:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8000/0x710df789068e66d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853111.075199:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b8000 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:2.0:1787853111.075203:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8000/0x710df789068e66d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853111.075209:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8000/0x710df789068e66d8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853111.075221:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f491176bd00) 00010000:00010000:2.0:1787853111.075224:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787853111.075229:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8000/0x710df789068e66d8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853111.075235:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8000/0x710df789068e66d8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853111.075280:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8600/0x710df789068e66d1 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c507938970d expref: 53 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853111.075291:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f4914d11600) 00010000:00010000:2.0:1787853111.075293:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787853111.075296:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8600/0x710df789068e66d1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c507938970d expref: 53 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853111.075307:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49415b8600, rc 0) 00000100:00100000:2.0:1787853111.075375:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f492eb75e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+52:10474:x1874699526118528:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 Request processed in 503us (763us total) trans 4294967351 rc 301/301 00000100:00100000:2.0:1787853111.075383:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 70 00000100:00100000:0.0:1787853111.082051:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00010000:00010000:2.0:1787853111.083101:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787853111.083285:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526118656 00000100:00100000:3.0:1787853111.083296:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526118656 00000100:00100000:3.0:1787853111.083365:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 71 00000100:00100000:3.0:1787853111.083376:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f492eb77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+52:10474:x1874699526118656:12345-192.168.204.1@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787853111.083418:0:8462:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787853111.083529:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f492eb77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+52:10474:x1874699526118656:12345-192.168.204.1@tcp:53:lhsmtool_posix.0 Request processed in 154us (1489us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853111.083536:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 71 00000100:00100000:0.0:1787853111.094318:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853111.094411:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526118912 00000100:00100000:1.0:1787853111.094420:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526118912 00000100:00100000:1.0:1787853111.094477:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 72 00000100:00100000:1.0:1787853111.094500:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f492eb770c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+52:10474:x1874699526118912:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787853111.094520:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853111.094523:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787853111.094548:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e6692 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793896ff expref: 52 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853111.094603:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8f491176b400) 00010000:00010000:1.0:1787853111.094608:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787853111.094622:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad000/0x710df789068e66e6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c5079389714 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787853111.095071:0:5836:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:1.0:1787853111.095271:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ada00/0x710df789068e66ed lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853111.095286:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ada00/0x710df789068e66ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853111.095296:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ada00/0x710df789068e66ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853111.095349:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad000/0x710df789068e66e6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389714 expref: 54 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853111.095365:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ada00/0x710df789068e66ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389714 expref: 53 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853111.095373:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8f4914d11a00) 00010000:00010000:1.0:1787853111.095376:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787853111.095386:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f492a8ada00, rc 0) 00000100:00100000:1.0:1787853111.095443:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f492eb770c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+53:10474:x1874699526118912:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 Request processed in 944us (1134us total) trans 4294967352 rc 0/0 00000100:00100000:1.0:1787853111.095451:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 72 00000100:00100000:3.0:1787853111.111244:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853111.111332:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526119168 00000100:00100000:1.0:1787853111.111350:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526119168 00000100:00100000:1.0:1787853111.111434:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 73 00000100:00100000:1.0:1787853111.111444:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493c5ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+53:10474:x1874699526119168:12345-192.168.204.1@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787853111.111505:0:8462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787853111.111534:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ada00/0x710df789068e66ed lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389714 expref: 53 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853111.111556:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8f4914d11a00) 00010000:00010000:1.0:1787853111.111586:0:8462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787853111.111610:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e66fb lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853111.111624:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e66fb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853111.111635:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e66fb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853111.111651:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad600/0x710df789068e6702 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x25928fdf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853111.111658:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad600/0x710df789068e6702 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x25928fdf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853111.111664:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad600/0x710df789068e6702 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x25928fdf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853111.111784:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e66fb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853111.111792:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e66fb lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853111.111799:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e66fb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853111.111806:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f492a8ad200 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:1.0:1787853111.111811:0:8462:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e66fb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853111.111819:0:8462:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e66fb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853111.111828:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8f491176b400) 00010000:00010000:1.0:1787853111.111831:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787853111.111835:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e66fb lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853111.111842:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e66fb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853111.111855:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad600/0x710df789068e6702 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x25928fdf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853111.111861:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad600/0x710df789068e6702 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x25928fdf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853111.111867:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad600/0x710df789068e6702 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x25928fdf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853111.111880:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f492a8ad600 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:1.0:1787853111.111884:0:8462:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad600/0x710df789068e6702 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x25928fdf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853111.111890:0:8462:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad600/0x710df789068e6702 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x25928fdf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853111.111898:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x25928fdf (ffff8f4914d11300) 00010000:00010000:1.0:1787853111.111900:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787853111.111903:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad600/0x710df789068e6702 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x25928fdf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853111.111909:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad600/0x710df789068e6702 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x25928fdf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853111.112199:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493c5ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+52:10474:x1874699526119168:12345-192.168.204.1@tcp:36:lhsmtool_posix.0 Request processed in 754us (970us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787853111.112208:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 73 00000100:00100000:3.0:1787853111.134477:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853111.134734:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526119296 00000100:00100000:1.0:1787853111.134745:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526119296 00000100:00100000:1.0:1787853111.134807:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 74 00000100:00100000:1.0:1787853111.134820:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493c5ff0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+52:10474:x1874699526119296:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787853111.134843:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853111.134870:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad600/0x710df789068e6709 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c507938971b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853111.134913:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e6710 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853111.134944:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e6710 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853111.134955:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e6710 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853111.135054:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad600/0x710df789068e6709 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c507938971b expref: 54 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853111.135073:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e6710 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c507938971b expref: 53 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853111.135082:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8f4914d11300) 00010000:00010000:1.0:1787853111.135084:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787853111.135087:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f492a8ad200, rc 0) 00000100:00100000:1.0:1787853111.135161:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493c5ff0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+53:10474:x1874699526119296:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 Request processed in 344us (694us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853111.135169:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 74 00000100:00100000:2.0:1787853111.148907:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853111.150202:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526119552 00000100:00100000:3.0:1787853111.150214:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526119552 00000100:00100000:3.0:1787853111.150283:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 75 00000100:00100000:3.0:1787853111.150295:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493fd57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+53:10474:x1874699526119552:12345-192.168.204.1@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787853111.150381:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21200/0x710df789068e6717 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853111.150407:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21200/0x710df789068e6717 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853111.150418:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21200/0x710df789068e6717 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787853111.153228:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:0.0:1787853111.153245:0:5837:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 430694674507ns, next at 431694671004ns, rc = 0 00000004:00010000:0.0:1787853111.153358:0:5837:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009b816f50 reply state 00000000e8494221 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21200/0x710df789068e6717 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853111.153370:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787853111.153508:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493fd57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+55:10474:x1874699526119552:12345-192.168.204.1@tcp:36:lhsmtool_posix.0 Request processed in 3211us (4606us total) trans 4294967353 rc 0/0 00000100:00100000:0.0:1787853111.153517:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 75 00010000:00010000:2.0:1787853111.165563:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21200/0x710df789068e6717 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853111.165608:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21200/0x710df789068e6717 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853111.165618:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21200/0x710df789068e6717 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853111.165624:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4921e21200 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:2.0:1787853111.165631:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21200/0x710df789068e6717 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853111.165639:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21200/0x710df789068e6717 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853111.165661:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8f4914d11300) 00010000:00010000:2.0:1787853111.165664:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787853111.165670:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21200/0x710df789068e6717 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853111.165677:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21200/0x710df789068e6717 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853111.178223:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853111.178451:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526119680 00000100:00100000:1.0:1787853111.178462:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526119680 00000100:00100000:1.0:1787853111.178535:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 76 00000100:00100000:1.0:1787853111.178548:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4941742580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+54:10474:x1874699526119680:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787853111.178604:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853111.178626:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad600/0x710df789068e671e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c5079389722 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853111.178692:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad600/0x710df789068e671e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389722 expref: 55 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853111.178891:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad600/0x710df789068e671e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389722 expref: 55 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853111.178911:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8f4914d11300) 00010000:00010000:1.0:1787853111.178914:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787853111.178918:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f492a8ad600, rc 0) 00000100:00100000:1.0:1787853111.178979:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4941742580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+55:10474:x1874699526119680:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 Request processed in 435us (762us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853111.178986:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 76 00000100:00100000:2.0:1787853111.183925:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853111.184197:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526119808 00000100:00100000:0.0:1787853111.184206:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526119808 00000100:00100000:0.0:1787853111.184253:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 25 00000100:00100000:0.0:1787853111.184262:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49417421c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2361:x1874699526119808:12345-192.168.204.1@tcp:8:lhsmtool_posix.0 00010000:00080000:0.0:1787853111.184293:0:6681:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0000: connection from b1d98f5a-0be0-4f69-83a6-833c935c8205@192.168.204.1@tcp t0 exp 0000000000000000 cur 430 last 0 00000020:00000080:0.0:1787853111.184324:0:6681:0:(genops.c:1385:class_connect()) connect: client b1d98f5a-0be0-4f69-83a6-833c935c8205, cookie 0x710df789068e6725 00002000:00100000:0.0:1787853111.184336:0:6681:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli b1d98f5a-0be0-4f69-83a6-833c935c8205/ffff8f4912455800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113954 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787853111.184358:0:6681:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787853111.184792:0:6681:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787853111.184825:0:6681:0:(import.c:65:import_set_state_nolock()) ffff8f4912457000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787853111.184935:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49417421c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+6:2361:x1874699526119808:12345-192.168.204.1@tcp:8:lhsmtool_posix.0 Request processed in 672us (1019us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853111.184943:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 25 00000100:00100000:1.0:1787853111.191470:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853111.191566:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526119936 00000100:00100000:2.0:1787853111.191828:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526119936 00000100:00100000:2.0:1787853111.191942:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 26 00000100:00100000:2.0:1787853111.191953:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493bee8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+6:0:x1874699526119936:12345-192.168.204.1@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1787853111.192392:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:2.0:1787853111.256972:0:6712:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b1d98f5a-0be0-4f69-83a6-833c935c8205 00000001:00080000:2.0:1787853111.257024:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000100:00100000:0.0:1787853111.258265:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493bee8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+5:0:x1874699526119936:12345-192.168.204.1@tcp:2:lhsmtool_posix.0 Request processed in 66303us (66795us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1787853111.258292:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 26 00000100:00100000:3.0:1787853111.270848:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853111.271102:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526120192 00000100:00100000:1.0:1787853111.271113:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526120192 00000100:00100000:1.0:1787853111.271192:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 19 00000100:00100000:1.0:1787853111.271203:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493c5fcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+55:10474:x1874699526120192:12345-192.168.204.1@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787853111.271516:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493c5fcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+56:10474:x1874699526120192:12345-192.168.204.1@tcp:35:lhsmtool_posix.0 Request processed in 313us (676us total) trans 4294967354 rc 0/0 00000100:00100000:1.0:1787853111.271523:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 19 00000100:00100000:2.0:1787853111.279206:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853111.291908:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526120448 00000100:00100000:1.0:1787853111.291926:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526120448 00000100:00100000:1.0:1787853111.292003:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 77 00000100:00100000:1.0:1787853111.292014:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4941740b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+56:10474:x1874699526120448:12345-192.168.204.1@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787853111.292151:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4941740b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+56:10474:x1874699526120448:12345-192.168.204.1@tcp:57:lhsmtool_posix.0 Request processed in 138us (12954us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853111.292159:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 77 00000100:00100000:2.0:1787853111.299332:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853111.299435:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526120576 00000100:00100000:1.0:1787853111.299445:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526120576 00000100:00100000:1.0:1787853111.299505:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 78 00000100:00100000:1.0:1787853111.299514:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49417403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+56:10474:x1874699526120576:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787853111.299535:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853111.299556:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ada00/0x710df789068e672c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c5079389729 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853111.299643:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad800/0x710df789068e6733 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853111.299659:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad800/0x710df789068e6733 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853111.299684:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad800/0x710df789068e6733 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787853111.299723:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787853111.299742:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad800/0x710df789068e6733 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853111.299767:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ada00/0x710df789068e672c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389729 expref: 58 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853111.299782:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad800/0x710df789068e6733 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389729 expref: 57 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853111.299790:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8f4914d11300) 00010000:00010000:1.0:1787853111.299792:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787853111.299796:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f492a8ad800, rc 0) 00000100:00100000:1.0:1787853111.299872:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49417403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+57:10474:x1874699526120576:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 Request processed in 358us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853111.299879:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 78 00000100:00100000:3.0:1787853111.305302:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853111.305364:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526120704 00000100:00100000:1.0:1787853111.305374:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526120704 00000100:00100000:1.0:1787853111.305434:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 27 00000100:00100000:1.0:1787853111.305444:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493c5fed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+5:2363:x1874699526120704:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787853111.305462:0:6684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853111.305483:0:6684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f59738a4/0x710df789068e673a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c5079389730 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787853111.305509:0:6684:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a907937, blocks: 0x1 00010000:00010000:1.0:1787853111.305528:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=430s v=(0 0) 00010000:00010000:1.0:1787853111.305533:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787853111.305542:0:6684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f59738a4/0x710df789068e673a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389730 expref: 6 pid: 6684 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853111.305564:0:6684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f59738a4/0x710df789068e673a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389730 expref: 6 pid: 6684 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853111.305744:0:6684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f492a8ac000, rc 0) 00000100:00100000:2.0:1787853111.306288:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493c5fed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+6:2363:x1874699526120704:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 Request processed in 840us (991us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853111.306297:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 27 00000100:00100000:3.0:1787853111.314384:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853111.315618:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526120960 00000100:00100000:1.0:1787853111.315633:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526120960 00000100:00100000:1.0:1787853111.315705:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 79 00000100:00100000:1.0:1787853111.315716:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493c5fd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+57:10474:x1874699526120960:12345-192.168.204.1@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787853111.316168:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493c5fd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+57:10474:x1874699526120960:12345-192.168.204.1@tcp:57:lhsmtool_posix.0 Request processed in 452us (1790us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853111.316179:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 79 00000100:00100000:1.0:1787853111.320329:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853111.326064:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526121088 00000100:00100000:2.0:1787853111.326797:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526121088 00000100:00100000:3.0:1787853111.327380:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 28 00000100:00100000:3.0:1787853111.327392:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4905754450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+6:10474:x1874699526121088:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787853111.327412:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853111.327433:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003fa2ba9a/0x710df789068e6741 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c5079389737 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853111.327465:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f59738a4/0x710df789068e673a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389730 expref: 7 pid: 6684 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853111.327474:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787853111.327478:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787853111.327484:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003fa2ba9a/0x710df789068e6741 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389737 expref: 7 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853111.327518:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f59738a4/0x710df789068e673a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389730 expref: 7 pid: 6684 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853111.327550:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f59738a4/0x710df789068e673a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389730 expref: 7 pid: 6684 timeout: 530 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853111.327565:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f494159e580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6682:1874699552364160:192.168.204.1@tcp:104: 00000100:00100000:3.0:1787853111.328670:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f490652a300 going to sleep for 11 seconds 00000100:00100000:3.0:1787853111.340418:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853111.340454:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526121216 00000100:00100000:3.0:1787853111.340462:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526121216 00010000:00010000:3.0:1787853111.340502:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f59738a4/0x710df789068e673a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389730 expref: 8 pid: 6684 timeout: 530 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853111.340536:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 42 00000100:00100000:3.0:1787853111.340546:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f494159de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+8:2363:x1874699526121216:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787853111.340560:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787853111.340656:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f59738a4/0x710df789068e673a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389730 expref: 8 pid: 6684 timeout: 530 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853111.340671:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f59738a4/0x710df789068e673a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389730 expref: 8 pid: 6684 timeout: 530 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853111.340696:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787853111.340701:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787853111.340711:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003fa2ba9a/0x710df789068e6741 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389737 expref: 8 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853111.340744:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003fa2ba9a/0x710df789068e6741 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389737 expref: 8 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853111.340785:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000003fa2ba9a/0x710df789068e6741 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389737 expref: 8 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853111.340799:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f494159c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5824:1874699552364288:192.168.204.1@tcp:105: 00000100:00100000:3.0:1787853111.340869:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f4902db4480 going to sleep for 11 seconds 00010000:00010000:1.0:1787853111.341329:0:6682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f59738a4/0x710df789068e673a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389730 expref: 8 pid: 6684 timeout: 530 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853111.341346:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f494159e580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6682:1874699552364160:192.168.204.1@tcp:104: 00010000:00010000:1.0:1787853111.341371:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003fa2ba9a/0x710df789068e6741 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389737 expref: 7 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853111.341382:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4921e20c00, rc 0) 00000100:00100000:1.0:1787853111.341420:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4905754450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+7:10474:x1874699526121088:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 Request processed in 14030us (21102us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853111.341428:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 28 00000100:00100000:2.0:1787853111.346422:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f494159c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5824:1874699552364288:192.168.204.1@tcp:105: 00010000:00010000:2.0:1787853111.346449:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787853111.346510:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f494159de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+6:2363:x1874699526121216:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 5964us (6102us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853111.346521:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 42 00000100:00100000:2.0:1787853111.348517:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853111.348562:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526121344 00000100:00100000:2.0:1787853111.348583:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526121344 00002000:00100000:2.0:1787853111.348639:0:6689:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff8f4941741680 x1874699526121344/t0(0) o4->b1d98f5a-0be0-4f69-83a6-833c935c8205@192.168.204.1@tcp:287/0 lens 504/0 e 0 to 0 dl 1787853122 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787853111.348652:0:6689:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff8f4941741680 with x1874699526121344 ext(0->8) 00002000:00010000:2.0:1787853111.348657:0:6689:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8f4941741680 00000100:00100000:2.0:1787853111.348681:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 0 00000100:00100000:2.0:1787853111.348690:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4941741680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+6:2362:x1874699526121344:12345-192.168.204.1@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787853111.349286:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4941741680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+8:2362:x1874699526121344:12345-192.168.204.1@tcp:4:lhsmtool_posix.0 Request processed in 595us (778us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1787853111.349301:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 0 00002000:00100000:2.0:1787853111.349309:0:6689:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff8f4941741680 x1874699526121344/t4294967302(0) o4->b1d98f5a-0be0-4f69-83a6-833c935c8205@192.168.204.1@tcp:287/0 lens 504/448 e 0 to 0 dl 1787853122 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787853111.349317:0:6689:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff8f4941741680 with x1874699526121344 ext(0->8) 00002000:00010000:2.0:1787853111.349321:0:6689:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8f4941741680 00000100:00100000:3.0:1787853111.364658:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853111.364692:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526121472 00000100:00100000:3.0:1787853111.364701:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526121472 00000100:00100000:3.0:1787853111.364824:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 80 00000100:00100000:3.0:1787853111.364834:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f494159f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+57:10474:x1874699526121472:12345-192.168.204.1@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1787853111.465288:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f494159f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+57:10474:x1874699526121472:12345-192.168.204.1@tcp:44:lhsmtool_posix.0 Request processed in 100281us (100467us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853111.465304:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 80 00000001:00080000:1.0:1787853111.465470:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967349 is committed 00000001:00080000:1.0:1787853111.465495:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:1.0:1787853111.465515:0:5858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:1.0:1787853111.465539:0:5858:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8f49063f70c0 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:1.0:1787853111.465543:0:5858:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8f4908e77a00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8f49063f7f00 00000020:00080000:1.0:1787853111.465546:0:5858:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8f4908e77d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8f4906787400 00000004:00080000:1.0:1787853111.465601:0:5858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:2.0:1787853111.466286:0:5870:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:2.0:1787853111.466405:0:5870:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:1.0:1787853111.466654:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f493beea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552364416:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787853111.468309:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853111.468395:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552364416 00000100:00100000:1.0:1787853111.468395:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787853111.468404:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552364416 00000100:00100000:1.0:1787853111.468406:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f494159c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552364544:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787853111.468447:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787853111.468452:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853111.468455:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493bee9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874699552364416:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787853111.468491:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552364544 00000100:00100000:1.0:1787853111.468494:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552364544 00000100:00100000:1.0:1787853111.468519:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787853111.468542:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493beeb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3306:x1874699552364544:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1787853111.468557:0:8463:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:1.0:1787853111.468602:0:8463:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a907933, atime: 0x6a907934, ctime: 0x6a907933, blocks: 0xb 00010000:00010000:1.0:1787853111.468610:0:8463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f59738a4/0x710df789068e6748 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853111.468626:0:8463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=431s v=(0 0) 00002000:00010000:3.0:1787853111.468627:0:6681:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1787853111.468630:0:6681:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787853111 00002000:00010000:3.0:1787853111.468632:0:6681:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00010000:00010000:1.0:1787853111.468632:0:8463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00002000:00010000:3.0:1787853111.468634:0:6681:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1787853111 -> 1787853111 00010000:00010000:1.0:1787853111.468638:0:8463:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f59738a4/0x710df789068e6748 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787853111.468642:0:6681:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00010000:00010000:1.0:1787853111.468655:0:8463:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f59738a4/0x710df789068e6748 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853111.468665:0:8463:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f59738a4/0x710df789068e6748 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853111.468673:0:8463:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f59738a4/0x710df789068e6748 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853111.468681:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493bee9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3306:x1874699552364416:12345-0@lo:2:osp-syn-0-0.0 Request processed in 228us (1968us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1787853111.468689:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:1.0:1787853111.468691:0:8463:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787853111.469192:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493beeb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3306:x1874699552364544:12345-0@lo:6:osp-syn-1-0.0 Request processed in 649us (737us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1787853111.472413:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000004:00080000:1.0:1787853111.472511:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8f494159c000/2, rc 0, transno 4294967301 00000100:00100000:1.0:1787853111.472519:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f494159c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552364544:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1787853111.472533:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8f493beea580/2, rc 0, transno 4294967303 00000100:00100000:1.0:1787853111.472553:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f493beea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552364416:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1787853111.472589:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787853111.472598:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f59738a4/0x710df789068e6748 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853111.472611:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f492a8ac000 already unused, calling callback (ffffffffc1528440) 00010000:00010000:1.0:1787853111.472617:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f59738a4/0x710df789068e6748 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853111.472629:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f59738a4/0x710df789068e6748 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853111.472653:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f59738a4/0x710df789068e6748 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853111.472662:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f59738a4/0x710df789068e6748 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853111.472685:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853111.472686:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853111.472688:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787853111.478840:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853111.479381:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526121600 00000100:00100000:1.0:1787853111.479390:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526121600 00000100:00100000:1.0:1787853111.479447:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 31 00000100:00100000:1.0:1787853111.479456:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f494159da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+8:2363:x1874699526121600:12345-192.168.204.1@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1787853111.534152:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4941740780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874699552364672:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787853111.534240:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853111.534332:0:10348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552364672 00000100:00100000:1.0:1787853111.534341:0:10348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552364672 00000100:00100000:1.0:1787853111.534391:0:10348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787853111.534400:0:10348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493bee8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1874699552364672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787853111.534423:0:10348:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787853111.534468:0:10348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493bee8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1874699552364672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853111.534475:0:10348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787853111.534523:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4941740780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874699552364672:0@lo:13:osp-pre-0-0.0 00000001:00080000:3.0:1787853111.534872:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00080000:3.0:1787853111.534900:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:1.0:1787853111.535167:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f494159da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+6:2363:x1874699526121600:12345-192.168.204.1@tcp:16:lhsmtool_posix.0 Request processed in 55710us (56331us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853111.535176:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 31 00000100:00100000:3.0:1787853111.537257:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f492eb76940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874699552364800:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787853111.537318:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853111.537410:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552364800 00000100:00100000:0.0:1787853111.537418:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552364800 00000100:00100000:0.0:1787853111.537471:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787853111.537480:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f494159ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1874699552364800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787853111.537512:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787853111.537559:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f494159ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1874699552364800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853111.537566:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787853111.537873:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f492eb76940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874699552364800:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787853111.547200:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853111.547256:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526121856 00000100:00100000:3.0:1787853111.547264:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526121856 00000100:00100000:3.0:1787853111.547324:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 81 00000100:00100000:3.0:1787853111.547333:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f494159f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+13:10474:x1874699526121856:12345-192.168.204.1@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787853111.547387:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787853111.547417:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad800/0x710df789068e6733 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389729 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853111.547435:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8f4914d11300) 00010000:00010000:3.0:1787853111.547441:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787853111.547469:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e674f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853111.547482:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e674f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853111.547492:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e674f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787853111.550375:0:5837:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d0b7a4d9 reply state 000000004dbe1769 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e674f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853111.550393:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787853111.550518:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f494159f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+14:10474:x1874699526121856:12345-192.168.204.1@tcp:36:lhsmtool_posix.0 Request processed in 3182us (3895us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1787853111.550528:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 81 00010000:00010000:1.0:1787853111.555361:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e674f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853111.555379:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e674f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853111.555386:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e674f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853111.555393:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4921e20000 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:1.0:1787853111.555398:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e674f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853111.555406:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e674f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853111.555437:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8f4914d11300) 00010000:00010000:1.0:1787853111.555440:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787853111.555446:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e674f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853111.555452:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e674f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853111.556838:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853111.556872:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526121984 00000100:00100000:1.0:1787853111.556882:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526121984 00000100:00100000:1.0:1787853111.556935:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 32 00000100:00100000:1.0:1787853111.556944:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493bee83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+6:2365:x1874699526121984:12345-192.168.204.1@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787853111.560348:0:6682:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1787853111.560355:0:6682:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1787853111 -> 1787853110 00002000:00010000:1.0:1787853111.560358:0:6682:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787853108 00002000:00010000:1.0:1787853111.560360:0:6682:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1787853111 -> 1787853110 00002000:00010000:1.0:1787853111.560363:0:6682:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1787853111.560445:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493bee83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+7:2365:x1874699526121984:12345-192.168.204.1@tcp:2:lhsmtool_posix.0 Request processed in 3497us (3611us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1787853111.560455:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 32 00000100:00100000:0.0:1787853111.563842:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853111.564523:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526122240 00000100:00100000:3.0:1787853111.564535:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526122240 00000100:00100000:3.0:1787853111.564716:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 82 00000100:00100000:3.0:1787853111.564728:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f492eb76940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+13:10474:x1874699526122240:12345-192.168.204.1@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787853111.564810:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20a00/0x710df789068e6756 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853111.564830:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e6710 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c507938971b expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853111.564838:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20a00/0x710df789068e6756 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853111.564872:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e6710 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.1@tcp remote: 0xd0a9c507938971b expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853111.564886:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e6710 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c507938971b expref: 13 pid: 5836 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853111.564901:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f494159e580 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5836:1874699552364928:192.168.204.1@tcp:104: 00000100:00100000:3.0:1787853111.565015:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f490664aa80 going to sleep for 11 seconds 00000100:00100000:0.0:1787853111.577320:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853111.577368:0:11175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526122368 00000100:00100000:0.0:1787853111.577380:0:11175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526122368 00010000:00010000:0.0:1787853111.577425:0:11175:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e6710 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c507938971b expref: 14 pid: 5836 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853111.577461:0:11175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 43 00000100:00100000:0.0:1787853111.577470:0:11175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f491e970c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b1d98f5a-0be0-4f69-83a6-833c935c8205+14:2362:x1874699526122368:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787853111.577484:0:11175:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787853111.577490:0:11175:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e6710 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c507938971b expref: 14 pid: 5836 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853111.577504:0:11175:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e6710 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c507938971b expref: 14 pid: 5836 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853111.577529:0:11175:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8f4914d11300) 00010000:00010000:0.0:1787853111.577548:0:11175:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20a00/0x710df789068e6756 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853111.577559:0:11175:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20a00/0x710df789068e6756 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853111.577567:0:11175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20a00/0x710df789068e6756 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853111.577605:0:11175:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787853111.578357:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e6710 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c507938971b expref: 14 pid: 5836 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853111.578376:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f494159e580 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5836:1874699552364928:192.168.204.1@tcp:104: 00010000:00010000:2.0:1787853111.578397:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20a00/0x710df789068e6756 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853111.578407:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20a00/0x710df789068e6756 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853111.578413:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20a00/0x710df789068e6756 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853111.578443:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20a00/0x710df789068e6756 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853111.578449:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20a00/0x710df789068e6756 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853111.578455:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20a00/0x710df789068e6756 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853111.578472:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4921e20a00 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:2.0:1787853111.578476:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20a00/0x710df789068e6756 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853111.578483:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20a00/0x710df789068e6756 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853111.578494:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8f4914d11300) 00010000:00010000:2.0:1787853111.578496:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1787853111.578500:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20a00/0x710df789068e6756 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853111.578505:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20a00/0x710df789068e6756 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853111.578607:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f492eb76940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+13:10474:x1874699526122240:12345-192.168.204.1@tcp:55:lhsmtool_posix.0 Request processed in 13880us (14773us total) trans 0 rc -22/-22 00000100:00100000:2.0:1787853111.578617:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 82 00000100:00100000:0.0:1787853111.579395:0:11175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f491e970c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b1d98f5a-0be0-4f69-83a6-833c935c8205+13:2362:x1874699526122368:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 1921us (2080us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853111.579406:0:11175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 43 00000100:00100000:2.0:1787853111.584421:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853111.585004:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526122496 00000100:00100000:1.0:1787853111.585016:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526122496 00000100:00100000:1.0:1787853111.585094:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 33 00000100:00100000:1.0:1787853111.585104:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4941742940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+7:2364:x1874699526122496:12345-192.168.204.1@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787853111.585857:0:8463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d150288e/0x710df789068e675d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853111.585888:0:8463:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003fa2ba9a/0x710df789068e6741 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389737 expref: 7 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853111.585896:0:8463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1787853111.585901:0:8463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787853111.585906:0:8463:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d150288e/0x710df789068e675d lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853111.585941:0:8463:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003fa2ba9a/0x710df789068e6741 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389737 expref: 7 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853111.585956:0:8463:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003fa2ba9a/0x710df789068e6741 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389737 expref: 7 pid: 6682 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853111.585969:0:8463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f493bee8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8463:1874699552365056:192.168.204.1@tcp:104: 00000100:00100000:1.0:1787853111.586054:0:8463:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f49050749c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787853111.592127:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853111.592704:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526122624 00000100:00100000:3.0:1787853111.592714:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526122624 00010000:00010000:3.0:1787853111.592770:0:8450:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003fa2ba9a/0x710df789068e6741 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389737 expref: 8 pid: 6682 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853111.592825:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 44 00000100:00100000:3.0:1787853111.592834:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493bee9e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+8:2363:x1874699526122624:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787853111.593050:0:8450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787853111.593077:0:8450:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003fa2ba9a/0x710df789068e6741 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389737 expref: 8 pid: 6682 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853111.593094:0:8450:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003fa2ba9a/0x710df789068e6741 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389737 expref: 8 pid: 6682 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853111.593137:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787853111.593142:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787853111.593148:0:8450:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d150288e/0x710df789068e675d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853111.593159:0:8450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d150288e/0x710df789068e675d lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853111.593182:0:8450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787853111.593320:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493bee9e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+8:2363:x1874699526122624:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 485us (1213us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853111.593328:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 44 00010000:00010000:3.0:1787853111.593398:0:8463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003fa2ba9a/0x710df789068e6741 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389737 expref: 7 pid: 6682 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853111.593415:0:8463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f493bee8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8463:1874699552365056:192.168.204.1@tcp:104: 00010000:00010000:3.0:1787853111.593437:0:8463:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d150288e/0x710df789068e675d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853111.593447:0:8463:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d150288e/0x710df789068e675d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853111.593454:0:8463:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d150288e/0x710df789068e675d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853111.593480:0:8463:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d150288e/0x710df789068e675d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853111.593488:0:8463:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d150288e/0x710df789068e675d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853111.593496:0:8463:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d150288e/0x710df789068e675d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853111.593503:0:8463:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f492a8ad800 already unused, calling callback (ffffffffc1528440) 00010000:00010000:3.0:1787853111.593507:0:8463:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d150288e/0x710df789068e675d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853111.593529:0:8463:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d150288e/0x710df789068e675d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853111.593540:0:8463:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d150288e/0x710df789068e675d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853111.593548:0:8463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d150288e/0x710df789068e675d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853111.593822:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4941742940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+6:2364:x1874699526122496:12345-192.168.204.1@tcp:1:lhsmtool_posix.0 Request processed in 8719us (9413us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853111.593831:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 33 00000100:00100000:1.0:1787853111.600544:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853111.601003:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526122880 00000100:00100000:2.0:1787853111.601014:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526122880 00000100:00100000:3.0:1787853111.602081:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 83 00000100:00100000:3.0:1787853111.602098:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493bee8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+12:10474:x1874699526122880:12345-192.168.204.1@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787853111.602438:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e6764 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853111.602459:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e6764 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853111.602473:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e6764 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853111.603037:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21200/0x710df789068e676b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853111.603053:0:8462:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad600/0x710df789068e671e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389722 expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853111.603070:0:8462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21200/0x710df789068e676b lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853111.603109:0:8462:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad600/0x710df789068e671e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389722 expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853111.603144:0:8462:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad600/0x710df789068e671e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389722 expref: 13 pid: 5836 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853111.603160:0:8462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f494159de00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8462:1874699552365184:192.168.204.1@tcp:104: 00000100:00100000:3.0:1787853111.603281:0:8462:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f490664a480 going to sleep for 11 seconds 00000100:00100000:2.0:1787853111.607260:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853111.607342:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526123008 00000100:00100000:1.0:1787853111.607351:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526123008 00010000:00010000:1.0:1787853111.607392:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad600/0x710df789068e671e lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389722 expref: 14 pid: 5836 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853111.607439:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 45 00000100:00100000:1.0:1787853111.607448:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4941740780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+14:2362:x1874699526123008:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787853111.607473:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787853111.607481:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad600/0x710df789068e671e lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389722 expref: 14 pid: 5836 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853111.607495:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad600/0x710df789068e671e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389722 expref: 14 pid: 5836 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853111.607522:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8f4914d11300) 00010000:00010000:1.0:1787853111.607529:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21200/0x710df789068e676b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853111.607540:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21200/0x710df789068e676b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853111.607548:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21200/0x710df789068e676b lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853111.607586:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787853111.607727:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4941740780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+14:2362:x1874699526123008:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 278us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853111.607735:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 45 00010000:00010000:3.0:1787853111.608645:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad600/0x710df789068e671e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389722 expref: 13 pid: 5836 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853111.608664:0:8462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f494159de00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8462:1874699552365184:192.168.204.1@tcp:104: 00010000:00010000:3.0:1787853111.608687:0:8462:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21200/0x710df789068e676b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853111.608697:0:8462:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21200/0x710df789068e676b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853111.608703:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21200/0x710df789068e676b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787853111.608911:0:8462:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:3.0:1787853111.609068:0:8462:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:3.0:1787853111.609375:0:8462:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:3.0:1787853111.609478:0:8462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f494159de00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8462:1874699552365312:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787853111.609555:0:8462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853111.610417:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552365312 00000100:00100000:2.0:1787853111.610428:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552365312 00000100:00100000:3.0:1787853111.610443:0:8462:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f490664a780 going to sleep for 11 seconds 00000100:00100000:2.0:1787853111.610530:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787853111.610539:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f494159e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:8462:x1874699552365312:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787853111.610668:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f494159e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:8462:x1874699552365312:12345-0@lo:1000:mdt00_003.0 Request processed in 130us (1112us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853111.610676:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787853111.610756:0:8462:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:3.0:1787853111.610763:0:8462:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8f493beea580, transno 4294967303 00000100:00100000:3.0:1787853111.610778:0:8462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f494159de00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8462:1874699552365312:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1787853111.611377:0:8462:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:3.0:1787853111.611456:0:8462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f494159de00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8462:1874699552365440:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787853111.611500:0:8462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853111.612189:0:8462:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f49419c43c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787853111.612294:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552365440 00000100:00100000:1.0:1787853111.612303:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552365440 00000100:00100000:1.0:1787853111.612346:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787853111.612356:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49079f2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:8462:x1874699552365440:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787853111.612649:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49079f2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:8462:x1874699552365440:12345-0@lo:1000:mdt00_003.0 Request processed in 294us (1148us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1787853111.612658:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787853111.613523:0:8462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f494159de00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8462:1874699552365440:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1787853111.613608:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21200/0x710df789068e676b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853111.613629:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21200/0x710df789068e676b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853111.613639:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21200/0x710df789068e676b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853111.613646:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4921e21200 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:3.0:1787853111.613652:0:8462:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21200/0x710df789068e676b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853111.613672:0:8462:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21200/0x710df789068e676b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853111.613693:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8f4914d11300) 00010000:00010000:3.0:1787853111.613696:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787853111.613703:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21200/0x710df789068e676b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853111.613726:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21200/0x710df789068e676b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853111.613778:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7600/0x710df789068e6699 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853111.613784:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7600/0x710df789068e6699 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853111.613790:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7600/0x710df789068e6699 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853111.613795:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b7600 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:3.0:1787853111.613798:0:8462:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7600/0x710df789068e6699 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853111.613805:0:8462:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7600/0x710df789068e6699 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853111.613813:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f491176bd00) 00010000:00010000:3.0:1787853111.613816:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787853111.613818:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7600/0x710df789068e6699 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853111.613823:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7600/0x710df789068e6699 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853111.613860:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e6772 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853111.613878:0:8462:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21c00/0x710df789068e66b5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389706 expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853111.613892:0:8462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e6772 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853111.614629:0:8462:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21c00/0x710df789068e66b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389706 expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853111.614648:0:8462:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21c00/0x710df789068e66b5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389706 expref: 16 pid: 5838 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853111.614664:0:8462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f493c5a6940 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8462:1874699552365568:192.168.204.1@tcp:104: 00000100:00100000:3.0:1787853111.614783:0:8462:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f490664a480 going to sleep for 11 seconds 00000100:00100000:3.0:1787853111.619373:0:8462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f493c5a6940 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8462:1874699552365568:192.168.204.1@tcp:104: 00010000:00010000:3.0:1787853111.619405:0:8462:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e6772 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853111.620434:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853111.620672:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526123136 00000100:00100000:3.0:1787853111.620681:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526123136 00010000:00010000:3.0:1787853111.620718:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21c00/0x710df789068e66b5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389706 expref: 17 pid: 5838 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853111.620759:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 46 00000100:00100000:3.0:1787853111.620769:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493beea580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+17:2362:x1874699526123136:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787853111.620785:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787853111.620791:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21c00/0x710df789068e66b5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389706 expref: 17 pid: 5838 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853111.620818:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21c00/0x710df789068e66b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389706 expref: 17 pid: 5838 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853111.620840:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21c00/0x710df789068e66b5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389706 expref: 17 pid: 5838 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853111.620855:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f491176bd00) 00010000:00010000:3.0:1787853111.620860:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e6772 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853111.620870:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e6772 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853111.620878:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e6772 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853111.620910:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787853111.620962:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493beea580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+16:2362:x1874699526123136:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 194us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853111.620969:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 46 00010000:00010000:1.0:1787853111.621082:0:8462:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e6772 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853111.621090:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e6772 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853111.621103:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e6772 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853111.621109:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e6772 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853111.621126:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e6772 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853111.621131:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4921e20000 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:1.0:1787853111.621136:0:8462:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e6772 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853111.621143:0:8462:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e6772 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853111.621153:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f491176bd00) 00010000:00010000:1.0:1787853111.621155:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787853111.621159:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e6772 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853111.621165:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e6772 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853111.621176:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e6764 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853111.621191:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e6764 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853111.621396:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e6764 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853111.621402:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4921e20c00 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:1.0:1787853111.621405:0:8462:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e6764 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853111.621411:0:8462:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e6764 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853111.621420:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f491176bd00) 00010000:00010000:1.0:1787853111.621422:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787853111.621425:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e6764 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853111.621430:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e6764 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853111.622015:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493bee8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+15:10474:x1874699526122880:12345-192.168.204.1@tcp:57:lhsmtool_posix.0 Request processed in 19920us (21480us total) trans 4294967360 rc 0/0 00000100:00100000:1.0:1787853111.622025:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 83 00000020:00080000:1.0:1787853111.622029:0:8462:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1787853111.622071:0:11690:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787853111.622076:0:11690:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787853111.622134:0:11690:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1787853111.622142:0:11690:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787853111.625819:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853111.626406:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526123392 00000100:00100000:3.0:1787853111.626418:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526123392 00000100:00100000:3.0:1787853111.626501:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 20 00000100:00100000:3.0:1787853111.626512:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49031c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+15:10474:x1874699526123392:12345-192.168.204.1@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787853111.627503:0:5839:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787853111.627681:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:3.0:1787853111.628048:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21200/0x710df789068e6779 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853111.628081:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21200/0x710df789068e6779 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853111.628097:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21200/0x710df789068e6779 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853111.628108:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21200/0x710df789068e6779 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853111.628126:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21200/0x710df789068e6779 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853111.628133:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21200/0x710df789068e6779 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853111.628165:0:5839:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787853111.628319:0:8449:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787853111.628328:0:8449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21200/0x710df789068e6779 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853111.628335:0:8449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4921e21200 already unused, calling callback (ffffffffc1528440) 00010000:00010000:2.0:1787853111.628339:0:8449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21200/0x710df789068e6779 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853111.628347:0:8449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21200/0x710df789068e6779 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853111.628361:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8f4910f92b00) 00010000:00010000:2.0:1787853111.628363:0:8449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787853111.628368:0:8449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21200/0x710df789068e6779 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853111.628373:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21200/0x710df789068e6779 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853111.628392:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853111.628394:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853111.628396:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787853111.628514:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49031c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+17:10474:x1874699526123392:12345-192.168.204.1@tcp:35:lhsmtool_posix.0 Request processed in 1998us (2701us total) trans 4294967362 rc 0/0 00000100:00100000:3.0:1787853111.628525:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 20 00000020:00080000:3.0:1787853111.628532:0:5839:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:3.0:1787853111.971025:0:12007:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787853111.975125:0:12007:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787853111.975237:0:12007:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1787853111.975244:0:12007:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1787853112.106772:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787853112.200077:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853112.200402:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526123648 00000100:00100000:0.0:1787853112.200411:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526123648 00000100:00100000:0.0:1787853112.200472:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 84 00000100:00100000:0.0:1787853112.200482:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49417421c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+17:10485:x1874699526123648:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:0.0:1787853112.200510:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853112.200534:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7600/0x710df789068e6780 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c507938973e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853112.201445:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7a00/0x710df789068e6787 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853112.201465:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7a00/0x710df789068e6787 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853112.201478:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7a00/0x710df789068e6787 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787853112.201492:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:0.0:1787853112.201737:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7600/0x710df789068e6780 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c507938973e expref: 20 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853112.201754:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7a00/0x710df789068e6787 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c507938973e expref: 19 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853112.201764:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8f491176b400) 00010000:00010000:0.0:1787853112.201767:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787853112.201770:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49415b7a00, rc 0) 00000100:00100000:0.0:1787853112.203035:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49417421c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+19:10485:x1874699526123648:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 2546us (2957us total) trans 4294967363 rc 0/0 00000100:00100000:0.0:1787853112.203047:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 84 00000100:00100000:1.0:1787853112.219285:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853112.219526:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526123776 00000100:00100000:3.0:1787853112.219536:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526123776 00000100:00100000:3.0:1787853112.219605:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 85 00000100:00100000:3.0:1787853112.219615:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49031c0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+19:10485:x1874699526123776:12345-192.168.204.1@tcp:34:lfs.0 00010000:00010000:3.0:1787853112.219701:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21c00/0x710df789068e6795 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853112.219726:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21c00/0x710df789068e6795 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853112.219738:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21c00/0x710df789068e6795 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853112.219755:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21800/0x710df789068e679c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853112.219763:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21800/0x710df789068e679c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853112.219768:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21800/0x710df789068e679c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853112.220085:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20400/0x710df789068e67a3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853112.220112:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20400/0x710df789068e67a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853112.220121:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20400/0x710df789068e67a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787853112.220162:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20400/0x710df789068e67a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853112.220174:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21c00/0x710df789068e6795 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853112.220179:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21c00/0x710df789068e6795 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853112.220194:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21c00/0x710df789068e6795 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853112.220200:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4921e21c00 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:3.0:1787853112.220204:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21c00/0x710df789068e6795 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853112.220211:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21c00/0x710df789068e6795 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853112.220223:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8f491176b400) 00010000:00010000:3.0:1787853112.220227:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787853112.220232:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21c00/0x710df789068e6795 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853112.220238:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21c00/0x710df789068e6795 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853112.220251:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21800/0x710df789068e679c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853112.220256:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21800/0x710df789068e679c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853112.220262:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21800/0x710df789068e679c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853112.220267:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4921e21800 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:3.0:1787853112.220270:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21800/0x710df789068e679c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853112.220285:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21800/0x710df789068e679c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853112.220295:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8f4910f92100) 00010000:00010000:3.0:1787853112.220297:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787853112.220300:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21800/0x710df789068e679c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853112.220305:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21800/0x710df789068e679c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853112.220320:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20400/0x710df789068e67a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853112.220325:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20400/0x710df789068e67a3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853112.220330:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20400/0x710df789068e67a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853112.220334:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4921e20400 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:3.0:1787853112.220336:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20400/0x710df789068e67a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853112.220341:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20400/0x710df789068e67a3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853112.220347:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f4910f92b00) 00010000:00010000:3.0:1787853112.220349:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787853112.220351:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20400/0x710df789068e67a3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853112.220366:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20400/0x710df789068e67a3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853112.220462:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49031c0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+19:10485:x1874699526123776:12345-192.168.204.1@tcp:34:lfs.0 Request processed in 847us (1186us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853112.220471:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 85 00000100:00100000:1.0:1787853112.295192:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853112.297394:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526124032 00000100:00100000:2.0:1787853112.297410:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526124032 00000100:00100000:2.0:1787853112.297489:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 86 00000100:00100000:2.0:1787853112.297500:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49031c0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+19:10488:x1874699526124032:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:2.0:1787853112.297539:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853112.297563:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9c00/0x710df789068e67aa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c5079389745 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853112.297655:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8800/0x710df789068e67b1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853112.297670:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8800/0x710df789068e67b1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853112.297684:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8800/0x710df789068e67b1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853112.297699:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8200/0x710df789068e67b8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853112.297707:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8200/0x710df789068e67b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853112.297714:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8200/0x710df789068e67b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853112.298023:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9600/0x710df789068e67bf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853112.298032:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9600/0x710df789068e67bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853112.298040:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9600/0x710df789068e67bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787853112.298049:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1787853112.298158:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8800/0x710df789068e67b1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853112.298166:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8800/0x710df789068e67b1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853112.298172:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8800/0x710df789068e67b1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853112.298179:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b8800 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:2.0:1787853112.298183:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8800/0x710df789068e67b1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853112.298191:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8800/0x710df789068e67b1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853112.298205:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8f491176b400) 00010000:00010000:2.0:1787853112.298207:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787853112.298212:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8800/0x710df789068e67b1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853112.298218:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8800/0x710df789068e67b1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853112.298228:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8200/0x710df789068e67b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853112.298234:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8200/0x710df789068e67b8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853112.298240:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8200/0x710df789068e67b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853112.298245:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b8200 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:2.0:1787853112.298259:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8200/0x710df789068e67b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853112.298266:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8200/0x710df789068e67b8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853112.298274:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8f4910aab500) 00010000:00010000:2.0:1787853112.298277:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787853112.298280:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8200/0x710df789068e67b8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853112.298285:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8200/0x710df789068e67b8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853112.298324:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9c00/0x710df789068e67aa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389745 expref: 22 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853112.298336:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9600/0x710df789068e67bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389745 expref: 21 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853112.298343:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f4910aab300) 00010000:00010000:2.0:1787853112.298345:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787853112.298347:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49415b9600, rc 0) 00000100:00100000:2.0:1787853112.298831:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49031c0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+21:10488:x1874699526124032:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 1331us (3646us total) trans 4294967364 rc 0/0 00000100:00100000:2.0:1787853112.298840:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 86 00000100:00100000:2.0:1787853112.313948:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853112.314023:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526124160 00000100:00100000:3.0:1787853112.314032:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526124160 00000100:00100000:3.0:1787853112.314226:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 87 00000100:00100000:3.0:1787853112.314237:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49065d43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+21:10488:x1874699526124160:12345-192.168.204.1@tcp:54:lfs.0 00010000:00010000:3.0:1787853112.314305:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20400/0x710df789068e67cd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853112.314321:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20400/0x710df789068e67cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853112.314333:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20400/0x710df789068e67cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853112.314358:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20400/0x710df789068e67cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853112.314364:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20400/0x710df789068e67cd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853112.314370:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20400/0x710df789068e67cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853112.314376:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4921e20400 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:3.0:1787853112.314380:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20400/0x710df789068e67cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853112.314404:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20400/0x710df789068e67cd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853112.314417:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f4910aab300) 00010000:00010000:3.0:1787853112.314420:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787853112.314424:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20400/0x710df789068e67cd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853112.314431:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20400/0x710df789068e67cd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853112.315339:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49065d43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+21:10488:x1874699526124160:12345-192.168.204.1@tcp:54:lfs.0 Request processed in 1100us (1396us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853112.315349:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 87 00000100:00100000:1.0:1787853112.327377:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853112.327676:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526124416 00000100:00100000:3.0:1787853112.327692:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526124416 00000100:00100000:3.0:1787853112.327755:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 21 00000100:00100000:3.0:1787853112.327765:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f491040b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+21:10488:x1874699526124416:12345-192.168.204.1@tcp:35:lfs.0 00000100:00100000:3.0:1787853112.328016:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f491040b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+22:10488:x1874699526124416:12345-192.168.204.1@tcp:35:lfs.0 Request processed in 251us (648us total) trans 4294967365 rc 0/0 00000100:00100000:3.0:1787853112.328024:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 21 00000100:00100000:1.0:1787853112.414177:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853112.414276:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526124672 00000100:00100000:0.0:1787853112.414287:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526124672 00000100:00100000:0.0:1787853112.414353:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 88 00000100:00100000:0.0:1787853112.414365:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49031c21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+22:10017:x1874699526124672:12345-192.168.204.1@tcp:101:bash.0 00010000:00010000:0.0:1787853112.414389:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853112.414410:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7600/0x710df789068e67d4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c507938974c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853112.414518:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6a00/0x710df789068e67db lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853112.414534:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9600/0x710df789068e67bf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389745 expref: 23 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853112.414543:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6a00/0x710df789068e67db lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853112.414639:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9600/0x710df789068e67bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389745 expref: 23 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853112.414654:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9600/0x710df789068e67bf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389745 expref: 23 pid: 5836 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853112.414669:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f492eb752c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5838:1874699552365696:192.168.204.1@tcp:104: 00000100:00100000:0.0:1787853112.414760:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f494160a900 going to sleep for 11 seconds 00000100:00100000:2.0:1787853112.420118:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853112.420229:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526124800 00000100:00100000:3.0:1787853112.420238:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526124800 00010000:00010000:3.0:1787853112.420281:0:8450:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9600/0x710df789068e67bf lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389745 expref: 24 pid: 5836 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853112.420325:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 47 00000100:00100000:3.0:1787853112.420336:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49065d6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+24:2363:x1874699526124800:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787853112.420369:0:8450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787853112.420377:0:8450:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9600/0x710df789068e67bf lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389745 expref: 24 pid: 5836 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853112.420390:0:8450:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9600/0x710df789068e67bf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389745 expref: 24 pid: 5836 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853112.420426:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f4910aab300) 00010000:00010000:3.0:1787853112.420431:0:8450:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6a00/0x710df789068e67db lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853112.420441:0:8450:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6a00/0x710df789068e67db lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853112.420448:0:8450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6a00/0x710df789068e67db lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853112.420477:0:8450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787853112.420540:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49065d6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+24:2363:x1874699526124800:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 205us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853112.420547:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 47 00010000:00010000:0.0:1787853112.424503:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9600/0x710df789068e67bf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389745 expref: 23 pid: 5836 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853112.424530:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f492eb752c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5838:1874699552365696:192.168.204.1@tcp:104: 00010000:00010000:0.0:1787853112.424555:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6a00/0x710df789068e67db lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853112.424565:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6a00/0x710df789068e67db lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853112.424636:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6a00/0x710df789068e67db lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787853112.424661:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:0.0:1787853112.427209:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7600/0x710df789068e67d4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c507938974c expref: 24 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853112.427243:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6a00/0x710df789068e67db lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c507938974c expref: 23 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853112.427280:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f4910aab300) 00010000:00010000:0.0:1787853112.427283:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787853112.427286:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49415b6a00, rc 0) 00000100:00100000:0.0:1787853112.427369:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49031c21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+23:10017:x1874699526124672:12345-192.168.204.1@tcp:101:bash.0 Request processed in 13005us (13201us total) trans 4294967366 rc 0/0 00000100:00100000:0.0:1787853112.427379:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 88 00000100:00100000:2.0:1787853112.445132:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853112.445229:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526125056 00000100:00100000:1.0:1787853112.445239:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526125056 00000100:00100000:1.0:1787853112.445300:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 89 00000100:00100000:1.0:1787853112.445310:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49065d70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+23:10017:x1874699526125056:12345-192.168.204.1@tcp:36:bash.0 00010000:00010000:1.0:1787853112.445632:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ac000/0x710df789068e67e9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853112.445649:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ac000/0x710df789068e67e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853112.445661:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ac000/0x710df789068e67e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787853112.445926:0:8462:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:1.0:1787853112.445953:0:8462:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000045ad95ae reply state 00000000662c5519 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ac000/0x710df789068e67e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853112.445963:0:8462:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1787853112.446013:0:8462:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:1.0:1787853112.446131:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49065d70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+27:10017:x1874699526125056:12345-192.168.204.1@tcp:36:bash.0 Request processed in 820us (1007us total) trans 4294967369 rc 0/0 00000100:00100000:1.0:1787853112.446140:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 89 00000020:00080000:1.0:1787853112.446145:0:8462:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:2.0:1787853112.452042:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ac000/0x710df789068e67e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853112.452089:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ac000/0x710df789068e67e9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853112.452096:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ac000/0x710df789068e67e9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853112.452113:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f492a8ac000 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:2.0:1787853112.452118:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ac000/0x710df789068e67e9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853112.452125:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ac000/0x710df789068e67e9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853112.452144:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f4910aab300) 00010000:00010000:2.0:1787853112.452148:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787853112.452153:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ac000/0x710df789068e67e9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853112.452158:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ac000/0x710df789068e67e9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853112.453287:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853112.453599:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526125184 00000100:00100000:3.0:1787853112.453611:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526125184 00000100:00100000:3.0:1787853112.453672:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 90 00000100:00100000:3.0:1787853112.453683:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49065d5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+26:10017:x1874699526125184:12345-192.168.204.1@tcp:101:bash.0 00010000:00010000:3.0:1787853112.453712:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853112.453733:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20400/0x710df789068e67f0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c5079389753 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853112.453885:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20400/0x710df789068e67f0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389753 expref: 27 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853112.453900:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20400/0x710df789068e67f0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389753 expref: 27 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853112.453920:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f4910aab300) 00010000:00010000:3.0:1787853112.453923:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787853112.453927:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4921e20400, rc 0) 00000100:00100000:3.0:1787853112.453992:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49065d5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+27:10017:x1874699526125184:12345-192.168.204.1@tcp:101:bash.0 Request processed in 312us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853112.453999:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 90 00000100:00100000:3.0:1787853112.466308:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853112.466379:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526125312 00000100:00100000:1.0:1787853112.466388:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526125312 00000100:00100000:1.0:1787853112.466460:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 34 00000100:00100000:1.0:1787853112.466471:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493c5a6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+6:10017:x1874699526125312:12345-192.168.204.1@tcp:101:bash.0 00010000:00010000:1.0:1787853112.466489:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853112.466511:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d150288e/0x710df789068e67f7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c507938975a expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787853112.466557:0:6682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a907936, atime: 0x6a907934, ctime: 0x6a907936, blocks: 0xb 00010000:00010000:1.0:1787853112.466619:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=432s v=(0 0) 00010000:00010000:1.0:1787853112.466624:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787853112.466633:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d150288e/0x710df789068e67f7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.1@tcp remote: 0xd0a9c507938975a expref: 7 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853112.466656:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d150288e/0x710df789068e67f7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.1@tcp remote: 0xd0a9c507938975a expref: 7 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853112.466671:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f492a8ad800, rc 0) 00000100:00100000:1.0:1787853112.466871:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493c5a6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+7:10017:x1874699526125312:12345-192.168.204.1@tcp:101:bash.0 Request processed in 401us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853112.466879:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 34 00000100:00100000:2.0:1787853112.483186:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853112.485824:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526125440 00000100:00100000:3.0:1787853112.485841:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526125440 00002000:00010000:3.0:1787853112.485894:0:6687:0:(ofd_dev.c:2831:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:3.0:1787853112.485899:0:6687:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff8f49065d7c00 with x1874699526125440 ext(0->18446744073709551615) 00002000:00010000:3.0:1787853112.485912:0:6687:0:(ofd_dev.c:2836:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8f49065d7c00. 00000100:00100000:3.0:1787853112.485960:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 1 00000100:00100000:3.0:1787853112.485971:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49065d7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+7:2364:x1874699526125440:12345-192.168.204.1@tcp:10:bash.0 00002000:00010000:3.0:1787853112.486303:0:6687:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1787853112.486307:0:6687:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1787853110 -> 1787853112 00002000:00010000:3.0:1787853112.486309:0:6687:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1787853108 -> 1787853108 00002000:00010000:3.0:1787853112.486311:0:6687:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1787853110 -> 1787853112 00002000:00010000:3.0:1787853112.486313:0:6687:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1787853112.486402:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49065d7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+8:2364:x1874699526125440:12345-192.168.204.1@tcp:10:bash.0 Request processed in 433us (3225us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1787853112.486410:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 1 00002000:00010000:3.0:1787853112.486425:0:6687:0:(ofd_dev.c:2831:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:3.0:1787853112.486428:0:6687:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff8f49065d7c00 with x1874699526125440 ext(0->18446744073709551615) 00002000:00010000:3.0:1787853112.486433:0:6687:0:(ofd_dev.c:2836:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8f49065d7c00. 00000100:00100000:3.0:1787853112.594629:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853112.594755:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526125568 00000100:00100000:1.0:1787853112.594764:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526125568 00000100:00100000:1.0:1787853112.594821:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 91 00000100:00100000:1.0:1787853112.594837:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493c5a52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+27:10502:x1874699526125568:12345-192.168.204.1@tcp:34:lfs.0 00010000:00010000:1.0:1787853112.594910:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ada00/0x710df789068e67fe lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853112.594927:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ada00/0x710df789068e67fe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853112.594941:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ada00/0x710df789068e67fe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853112.594975:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad000/0x710df789068e6805 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853112.594982:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad000/0x710df789068e6805 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853112.594989:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad000/0x710df789068e6805 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853112.595471:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ac400/0x710df789068e680c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853112.595481:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ac400/0x710df789068e680c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853112.595487:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ac400/0x710df789068e680c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787853112.595525:0:8462:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ac400/0x710df789068e680c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853112.595536:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ada00/0x710df789068e67fe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853112.595542:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ada00/0x710df789068e67fe lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853112.595549:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ada00/0x710df789068e67fe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853112.595555:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f492a8ada00 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:1.0:1787853112.595558:0:8462:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ada00/0x710df789068e67fe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853112.595605:0:8462:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ada00/0x710df789068e67fe lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853112.595617:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8f491176b400) 00010000:00010000:1.0:1787853112.595620:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787853112.595624:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ada00/0x710df789068e67fe lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853112.595630:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ada00/0x710df789068e67fe lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853112.595643:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad000/0x710df789068e6805 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853112.595648:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad000/0x710df789068e6805 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853112.595653:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad000/0x710df789068e6805 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853112.595658:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f492a8ad000 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:1.0:1787853112.595660:0:8462:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad000/0x710df789068e6805 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853112.595666:0:8462:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad000/0x710df789068e6805 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853112.595672:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8f4914d11d00) 00010000:00010000:1.0:1787853112.595674:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787853112.595677:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad000/0x710df789068e6805 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853112.595692:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad000/0x710df789068e6805 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853112.595706:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ac400/0x710df789068e680c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853112.595712:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ac400/0x710df789068e680c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853112.595717:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ac400/0x710df789068e680c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853112.595721:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f492a8ac400 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:1.0:1787853112.595724:0:8462:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ac400/0x710df789068e680c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853112.595729:0:8462:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ac400/0x710df789068e680c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853112.595736:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f4910aab300) 00010000:00010000:1.0:1787853112.595738:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787853112.595740:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ac400/0x710df789068e680c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853112.595745:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ac400/0x710df789068e680c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853112.596015:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493c5a52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+27:10502:x1874699526125568:12345-192.168.204.1@tcp:34:lfs.0 Request processed in 1173us (1390us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853112.596024:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 91 00000100:00100000:0.0:1787853112.650419:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853112.650471:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853112.650564:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526125696 00000100:00100000:1.0:1787853112.650608:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526125696 00002000:00100000:1.0:1787853112.650925:0:6688:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3:0x0] (0->7) req@ffff8f492eb752c0 x1874699526125696/t0(0) o4->b1d98f5a-0be0-4f69-83a6-833c935c8205@192.168.204.1@tcp:288/0 lens 496/0 e 0 to 0 dl 1787853123 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787853112.650937:0:6688:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff8f492eb752c0 with x1874699526125696 ext(0->7) 00002000:00010000:1.0:1787853112.650943:0:6688:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8f492eb752c0 00000100:00100000:0.0:1787853112.651048:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 2 00000100:00100000:0.0:1787853112.651058:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f492eb752c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+8:2364:x1874699526125696:12345-192.168.204.1@tcp:4:bash.0 00000100:00100000:3.0:1787853112.652164:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526125824 00000100:00100000:3.0:1787853112.652174:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526125824 00000100:00100000:3.0:1787853112.652222:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 35 00000100:00100000:3.0:1787853112.652230:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49216e6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+11:2364:x1874699526125824:12345-192.168.204.1@tcp:16:kworker.0 00000100:00100000:0.0:1787853112.652929:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f492eb752c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+11:2364:x1874699526125696:12345-192.168.204.1@tcp:4:bash.0 Request processed in 1870us (2517us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1787853112.652938:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 2 00002000:00100000:0.0:1787853112.652948:0:6688:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3:0x0] (0->7) req@ffff8f492eb752c0 x1874699526125696/t4294967307(0) o4->b1d98f5a-0be0-4f69-83a6-833c935c8205@192.168.204.1@tcp:288/0 lens 496/448 e 0 to 0 dl 1787853123 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787853112.652958:0:6688:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff8f492eb752c0 with x1874699526125696 ext(0->7) 00002000:00010000:0.0:1787853112.652963:0:6688:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8f492eb752c0 00000100:00100000:2.0:1787853112.708105:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853112.708775:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526126080 00000100:00100000:0.0:1787853112.708786:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526126080 00000100:00100000:0.0:1787853112.708844:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 92 00000100:00100000:0.0:1787853112.708854:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49065d7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+27:10505:x1874699526126080:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:0.0:1787853112.708873:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853112.708894:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6400/0x710df789068e6813 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c5079389761 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853112.708985:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7200/0x710df789068e681a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853112.709001:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7200/0x710df789068e681a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853112.709012:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7200/0x710df789068e681a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853112.709027:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6800/0x710df789068e6821 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853112.709034:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6800/0x710df789068e6821 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853112.709042:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6800/0x710df789068e6821 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853112.710608:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e6828 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853112.710624:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e6828 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853112.710645:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e6828 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787853112.710664:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1787853112.710768:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7200/0x710df789068e681a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853112.710776:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7200/0x710df789068e681a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853112.710790:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7200/0x710df789068e681a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853112.710796:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b7200 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:0.0:1787853112.710801:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7200/0x710df789068e681a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853112.710809:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7200/0x710df789068e681a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853112.710821:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8f491176b400) 00010000:00010000:0.0:1787853112.710824:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787853112.710829:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7200/0x710df789068e681a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853112.710835:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7200/0x710df789068e681a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853112.710852:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6800/0x710df789068e6821 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853112.710858:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6800/0x710df789068e6821 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853112.710864:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6800/0x710df789068e6821 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853112.710868:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b6800 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:0.0:1787853112.710871:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6800/0x710df789068e6821 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853112.710887:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6800/0x710df789068e6821 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853112.710896:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8f491176b100) 00010000:00010000:0.0:1787853112.710899:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787853112.710902:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6800/0x710df789068e6821 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853112.710907:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6800/0x710df789068e6821 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853112.710966:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6400/0x710df789068e6813 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389761 expref: 30 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853112.710981:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e6828 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389761 expref: 29 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853112.710989:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f4910aab300) 00010000:00010000:0.0:1787853112.710991:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787853112.710993:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49415b6200, rc 0) 00000100:00100000:0.0:1787853112.717031:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49065d7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+29:10505:x1874699526126080:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 8166us (8943us total) trans 4294967370 rc 0/0 00000100:00100000:0.0:1787853112.717043:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 92 00000100:00100000:3.0:1787853112.724290:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000001:00080000:1.0:1787853112.724755:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000001:00080000:1.0:1787853112.724771:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000100:00100000:3.0:1787853112.725079:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49216e6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+6:2364:x1874699526125824:12345-192.168.204.1@tcp:16:kworker.0 Request processed in 72847us (74603us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853112.725100:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 35 00000100:00100000:2.0:1787853112.728224:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526126208 00000100:00100000:2.0:1787853112.728241:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526126208 00000100:00100000:2.0:1787853112.728374:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 93 00000100:00100000:2.0:1787853112.728385:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493c5a7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+29:10505:x1874699526126208:12345-192.168.204.1@tcp:54:lfs.0 00010000:00010000:2.0:1787853112.728472:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8a00/0x710df789068e6836 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853112.728508:0:8462:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6a00/0x710df789068e67db lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c507938974c expref: 29 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853112.728519:0:8462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8a00/0x710df789068e6836 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853112.728556:0:8462:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6a00/0x710df789068e67db lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.1@tcp remote: 0xd0a9c507938974c expref: 29 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853112.728598:0:8462:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6a00/0x710df789068e67db lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c507938974c expref: 29 pid: 5838 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853112.728614:0:8462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4934234b40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8462:1874699552365824:192.168.204.1@tcp:104: 00000100:00100000:2.0:1787853112.728724:0:8462:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f4904c000c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787853112.732544:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853112.732627:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526126464 00000100:00100000:3.0:1787853112.732637:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526126464 00000100:00100000:3.0:1787853112.732690:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 22 00000100:00100000:3.0:1787853112.732707:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49031c2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+30:5607:x1874699526126464:12345-192.168.204.1@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787853112.733050:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49031c2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+31:5607:x1874699526126464:12345-192.168.204.1@tcp:35:ldlm_bl.0 Request processed in 344us (516us total) trans 4294967371 rc 0/0 00000100:00100000:3.0:1787853112.733058:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 22 00000100:00100000:2.0:1787853112.734413:0:8462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4934234b40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8462:1874699552365824:192.168.204.1@tcp:104: 00010000:00010000:2.0:1787853112.734441:0:8462:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8a00/0x710df789068e6836 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853112.739397:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853112.739609:0:11175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526126592 00000100:00100000:2.0:1787853112.739621:0:11175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526126592 00010000:00010000:2.0:1787853112.739675:0:11175:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6a00/0x710df789068e67db lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c507938974c expref: 31 pid: 5838 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853112.739728:0:11175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 48 00000100:00100000:2.0:1787853112.739739:0:11175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49031c2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b1d98f5a-0be0-4f69-83a6-833c935c8205+31:2363:x1874699526126592:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787853112.739755:0:11175:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787853112.739778:0:11175:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6a00/0x710df789068e67db lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c507938974c expref: 31 pid: 5838 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853112.739792:0:11175:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6a00/0x710df789068e67db lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c507938974c expref: 31 pid: 5838 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853112.739816:0:11175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6a00/0x710df789068e67db lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c507938974c expref: 31 pid: 5838 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853112.739845:0:11175:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f4910aab300) 00010000:00010000:2.0:1787853112.739850:0:11175:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8a00/0x710df789068e6836 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853112.739859:0:11175:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8a00/0x710df789068e6836 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853112.739867:0:11175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8a00/0x710df789068e6836 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853112.739893:0:11175:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787853112.739947:0:11175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49031c2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b1d98f5a-0be0-4f69-83a6-833c935c8205+30:2363:x1874699526126592:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 210us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853112.739955:0:11175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 48 00010000:00010000:0.0:1787853112.740182:0:8462:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8a00/0x710df789068e6836 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853112.740191:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8a00/0x710df789068e6836 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853112.740241:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8a00/0x710df789068e6836 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853112.740249:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8a00/0x710df789068e6836 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853112.740256:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8a00/0x710df789068e6836 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853112.740263:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b8a00 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:0.0:1787853112.740268:0:8462:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8a00/0x710df789068e6836 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853112.740277:0:8462:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8a00/0x710df789068e6836 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853112.740287:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f4910aab300) 00010000:00010000:0.0:1787853112.740289:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787853112.740293:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8a00/0x710df789068e6836 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853112.740298:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8a00/0x710df789068e6836 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853112.740342:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493c5a7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+29:10505:x1874699526126208:12345-192.168.204.1@tcp:54:lfs.0 Request processed in 11959us (16062us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853112.740349:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 93 00000100:00100000:0.0:1787853112.742729:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853112.742786:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526126848 00000100:00100000:3.0:1787853112.742796:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526126848 00000100:00100000:3.0:1787853112.742860:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 23 00000100:00100000:3.0:1787853112.742870:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4921694f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+29:10505:x1874699526126848:12345-192.168.204.1@tcp:35:lfs.0 00000100:00100000:3.0:1787853112.743297:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4921694f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+30:10505:x1874699526126848:12345-192.168.204.1@tcp:35:lfs.0 Request processed in 427us (578us total) trans 4294967372 rc 0/0 00000100:00100000:3.0:1787853112.743306:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 23 00000100:00100000:1.0:1787853112.843268:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853112.843350:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526127104 00000100:00100000:3.0:1787853112.843359:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526127104 00000100:00100000:3.0:1787853112.843414:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 94 00000100:00100000:3.0:1787853112.843423:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49031c3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+30:10516:x1874699526127104:12345-192.168.204.1@tcp:101:cat.0 00010000:00010000:3.0:1787853112.843445:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853112.843473:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21800/0x710df789068e683d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c5079389768 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853112.843559:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21c00/0x710df789068e6844 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853112.843661:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21c00/0x710df789068e6844 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853112.843673:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21c00/0x710df789068e6844 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853112.843689:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20e00/0x710df789068e684b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853112.843696:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20e00/0x710df789068e684b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853112.843703:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20e00/0x710df789068e684b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853112.844433:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21a00/0x710df789068e6852 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853112.844452:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21a00/0x710df789068e6852 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853112.844469:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21a00/0x710df789068e6852 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787853112.844482:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:3.0:1787853112.844605:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21c00/0x710df789068e6844 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853112.844612:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21c00/0x710df789068e6844 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853112.844617:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21c00/0x710df789068e6844 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853112.844623:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4921e21c00 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:3.0:1787853112.844627:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21c00/0x710df789068e6844 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853112.844634:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21c00/0x710df789068e6844 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853112.844645:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8f491176b400) 00010000:00010000:3.0:1787853112.844648:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787853112.844651:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21c00/0x710df789068e6844 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853112.844657:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21c00/0x710df789068e6844 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853112.844669:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20e00/0x710df789068e684b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853112.844681:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20e00/0x710df789068e684b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853112.844687:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20e00/0x710df789068e684b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853112.844691:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4921e20e00 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:3.0:1787853112.844694:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20e00/0x710df789068e684b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853112.844700:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20e00/0x710df789068e684b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853112.844709:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8f4910f92000) 00010000:00010000:3.0:1787853112.844711:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787853112.844714:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20e00/0x710df789068e684b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853112.844719:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20e00/0x710df789068e684b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853112.844764:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21800/0x710df789068e683d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389768 expref: 33 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853112.844779:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21a00/0x710df789068e6852 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389768 expref: 32 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853112.844786:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f4910aab300) 00010000:00010000:3.0:1787853112.844788:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787853112.844797:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4921e21a00, rc 0) 00000100:00100000:3.0:1787853112.845008:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49031c3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+32:10516:x1874699526127104:12345-192.168.204.1@tcp:101:cat.0 Request processed in 1584us (1749us total) trans 4294967373 rc 0/0 00000100:00100000:3.0:1787853112.845017:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 94 00000100:00100000:1.0:1787853112.851492:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853112.851612:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526127360 00000100:00100000:3.0:1787853112.851623:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526127360 00000100:00100000:3.0:1787853112.851685:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 24 00000100:00100000:3.0:1787853112.851696:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49031c30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+32:10516:x1874699526127360:12345-192.168.204.1@tcp:35:cat.0 00000100:00100000:3.0:1787853112.852781:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49031c30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+33:10516:x1874699526127360:12345-192.168.204.1@tcp:35:cat.0 Request processed in 1079us (1293us total) trans 4294967374 rc 0/0 00000100:00100000:3.0:1787853112.852792:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 24 00000100:00100000:0.0:1787853112.896498:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853112.897423:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526127616 00000100:00100000:3.0:1787853112.897434:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526127616 00000100:00100000:0.0:1787853112.897839:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 95 00000100:00100000:0.0:1787853112.897866:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49216952c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+33:10517:x1874699526127616:12345-192.168.204.1@tcp:36:rm.0 00010000:00010000:0.0:1787853112.898384:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787853112.898414:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21a00/0x710df789068e6852 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389768 expref: 33 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853112.898438:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e6828 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389761 expref: 32 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853112.898453:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20400/0x710df789068e67f0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389753 expref: 31 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853112.898462:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f4910aab300) 00010000:00010000:0.0:1787853112.898473:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787853112.898497:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7400/0x710df789068e6860 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853112.898512:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7400/0x710df789068e6860 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853112.898521:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7400/0x710df789068e6860 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853112.898536:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e6867 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853112.898543:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e6867 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853112.898550:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e6867 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853112.899239:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7e00/0x710df789068e686e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853112.899251:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7e00/0x710df789068e686e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853112.899260:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7e00/0x710df789068e686e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787853112.909289:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:0.0:1787853112.909305:0:5837:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 432450734664ns, next at 433450730664ns, rc = 0 00010000:00010000:0.0:1787853112.909394:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6600/0x710df789068e6875 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853112.909413:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6600/0x710df789068e6875 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853112.909426:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6600/0x710df789068e6875 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853112.909435:0:5837:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6600/0x710df789068e6875 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853112.909441:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6600/0x710df789068e6875 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853112.909446:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6600/0x710df789068e6875 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853112.910412:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787853112.910452:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7e00/0x710df789068e686e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853112.910725:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7e00/0x710df789068e686e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853112.910733:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7e00/0x710df789068e686e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853112.910740:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b7e00 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:0.0:1787853112.910744:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7e00/0x710df789068e686e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853112.910753:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7e00/0x710df789068e686e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853112.910768:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f491176bc00) 00010000:00010000:0.0:1787853112.910771:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787853112.910776:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7e00/0x710df789068e686e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853112.910782:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7e00/0x710df789068e686e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853112.910809:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7400/0x710df789068e6860 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853112.910815:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7400/0x710df789068e6860 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853112.910821:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7400/0x710df789068e6860 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853112.910826:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b7400 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:0.0:1787853112.910835:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7400/0x710df789068e6860 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853112.910841:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7400/0x710df789068e6860 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853112.910850:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8f491176b400) 00010000:00010000:0.0:1787853112.910852:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787853112.910856:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7400/0x710df789068e6860 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853112.910862:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7400/0x710df789068e6860 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787853112.910873:0:5837:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e6998d9c reply state 0000000086a277ab transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e6867 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853112.910882:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787853112.911075:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787853112.911082:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6600/0x710df789068e6875 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853112.911099:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b6600 already unused, calling callback (ffffffffc1528440) 00010000:00010000:1.0:1787853112.911102:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6600/0x710df789068e6875 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853112.911109:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6600/0x710df789068e6875 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853112.911127:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f491176bc00) 00010000:00010000:1.0:1787853112.911129:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787853112.911133:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6600/0x710df789068e6875 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853112.911139:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6600/0x710df789068e6875 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853112.911170:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853112.911172:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853112.911174:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787853112.911219:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49216952c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+32:10517:x1874699526127616:12345-192.168.204.1@tcp:36:rm.0 Request processed in 13351us (14727us total) trans 4294967375 rc 0/0 00000100:00100000:0.0:1787853112.911228:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 95 00010000:00010000:1.0:1787853112.917975:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e6867 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853112.917994:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e6867 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853112.918001:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e6867 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853112.918008:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b7c00 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:1.0:1787853112.918012:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e6867 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853112.918020:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e6867 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853112.918037:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8f491176b100) 00010000:00010000:1.0:1787853112.918040:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787853112.918045:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e6867 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853112.918051:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e6867 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853112.958165:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853112.962027:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526127872 00000100:00100000:2.0:1787853112.962042:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526127872 00000100:00100000:2.0:1787853112.962136:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 96 00000100:00100000:2.0:1787853112.962148:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4921694780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+31:10523:x1874699526127872:12345-192.168.204.1@tcp:101:bash.0 00010000:00010000:2.0:1787853112.962175:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853112.962198:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8600/0x710df789068e687c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c507938976f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853112.962357:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8000/0x710df789068e6883 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853112.962372:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8000/0x710df789068e6883 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853112.962383:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8000/0x710df789068e6883 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853112.962398:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8a00/0x710df789068e688a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853112.962404:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8a00/0x710df789068e688a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853112.962411:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8a00/0x710df789068e688a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787853112.963058:0:5838:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:2.0:1787853112.963238:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9e00/0x710df789068e6891 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853112.963250:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9e00/0x710df789068e6891 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853112.963259:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9e00/0x710df789068e6891 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853112.963296:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8000/0x710df789068e6883 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853112.963314:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8000/0x710df789068e6883 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853112.963321:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8000/0x710df789068e6883 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853112.963327:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b8000 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:2.0:1787853112.963332:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8000/0x710df789068e6883 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853112.963339:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8000/0x710df789068e6883 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853112.963352:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8f491176b400) 00010000:00010000:2.0:1787853112.963355:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787853112.963360:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8000/0x710df789068e6883 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853112.963366:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8000/0x710df789068e6883 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787853112.963381:0:5838:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000096cb3503 reply state 00000000f787b440 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8a00/0x710df789068e688a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853112.963390:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787853112.963422:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8600/0x710df789068e687c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c507938976f expref: 34 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853112.963435:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9e00/0x710df789068e6891 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c507938976f expref: 33 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853112.963454:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8f4910aab600) 00010000:00010000:2.0:1787853112.963457:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787853112.963464:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49415b9e00, rc 0) 00000100:00100000:2.0:1787853112.970036:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4921694780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+34:10523:x1874699526127872:12345-192.168.204.1@tcp:101:bash.0 Request processed in 7875us (11865us total) trans 4294967376 rc 0/0 00000100:00100000:2.0:1787853112.970051:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 96 00000100:00100000:3.0:1787853112.982282:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853112.982481:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526128000 00000100:00100000:1.0:1787853112.982492:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526128000 00000100:00100000:1.0:1787853112.982598:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 36 00000100:00100000:1.0:1787853112.982610:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493c5a4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+5:2363:x1874699526128000:12345-192.168.204.1@tcp:101:bash.0 00010000:00010000:1.0:1787853112.982645:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853112.982667:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000095a932e7/0x710df789068e689f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c5079389776 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787853112.982927:0:6682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787853112.982951:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=432s v=(0 0) 00010000:00010000:1.0:1787853112.982956:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787853112.982967:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000095a932e7/0x710df789068e689f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389776 expref: 6 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853112.982987:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000095a932e7/0x710df789068e689f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389776 expref: 6 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853112.983002:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f492a8ac400, rc 0) 00000100:00100000:1.0:1787853112.983061:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493c5a4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+6:2363:x1874699526128000:12345-192.168.204.1@tcp:101:bash.0 Request processed in 455us (789us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853112.983068:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 36 00000100:00080000:3.0:1787853112.983401:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787853112.986683:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8a00/0x710df789068e688a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853112.986712:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8a00/0x710df789068e688a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853112.986721:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8a00/0x710df789068e688a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853112.986729:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b8a00 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:0.0:1787853112.986755:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8a00/0x710df789068e688a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853112.986764:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8a00/0x710df789068e688a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853112.986784:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8f4910aab500) 00010000:00010000:0.0:1787853112.986788:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787853112.986794:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8a00/0x710df789068e688a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853112.986801:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8a00/0x710df789068e688a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853112.990764:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853112.990907:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526128128 00000100:00100000:3.0:1787853112.990916:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526128128 00000100:00100000:3.0:1787853112.990978:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 37 00000100:00100000:3.0:1787853112.990988:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4934234b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+6:10523:x1874699526128128:12345-192.168.204.1@tcp:101:bash.0 00010000:00010000:3.0:1787853112.991007:0:8463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853112.991026:0:8463:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8864ad2/0x710df789068e68a6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c507938977d expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853112.991060:0:8463:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000095a932e7/0x710df789068e689f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389776 expref: 7 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853112.991071:0:8463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787853112.991104:0:8463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787853112.991111:0:8463:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8864ad2/0x710df789068e68a6 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c507938977d expref: 7 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853112.991152:0:8463:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000095a932e7/0x710df789068e689f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389776 expref: 7 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853112.991167:0:8463:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000095a932e7/0x710df789068e689f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389776 expref: 7 pid: 6682 timeout: 532 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853112.991183:0:8463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f493c5a7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8463:1874699552365952:192.168.204.1@tcp:104: 00000100:00100000:3.0:1787853112.991296:0:8463:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f494160a6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787853113.001279:0:8463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f493c5a7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8463:1874699552365952:192.168.204.1@tcp:104: 00010000:00010000:3.0:1787853113.001318:0:8463:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a8864ad2/0x710df789068e68a6 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.1@tcp remote: 0xd0a9c507938977d expref: 7 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853113.001340:0:8463:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4921e21800, rc 0) 00000100:00100000:3.0:1787853113.001401:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4934234b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+7:10523:x1874699526128128:12345-192.168.204.1@tcp:101:bash.0 Request processed in 10413us (10649us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853113.001410:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 37 00000100:00100000:3.0:1787853113.013838:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853113.013950:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526128256 00000100:00100000:0.0:1787853113.013960:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526128256 00010000:00010000:0.0:1787853113.014001:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000095a932e7/0x710df789068e689f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389776 expref: 7 pid: 6682 timeout: 532 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853113.014048:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 49 00000100:00100000:0.0:1787853113.014058:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493c5a7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+7:2362:x1874699526128256:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787853113.014074:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787853113.014107:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000095a932e7/0x710df789068e689f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389776 expref: 7 pid: 6682 timeout: 532 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853113.014122:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000095a932e7/0x710df789068e689f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389776 expref: 7 pid: 6682 timeout: 532 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853113.014146:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000095a932e7/0x710df789068e689f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389776 expref: 7 pid: 6682 timeout: 532 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853113.014181:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787853113.014185:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787853113.014194:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a8864ad2/0x710df789068e68a6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.1@tcp remote: 0xd0a9c507938977d expref: 6 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853113.014203:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8864ad2/0x710df789068e68a6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.1@tcp remote: 0xd0a9c507938977d expref: 6 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853113.014242:0:5823:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a8864ad2/0x710df789068e68a6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.1@tcp remote: 0xd0a9c507938977d expref: 6 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853113.014257:0:5823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4921697840 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5823:1874699552366080:192.168.204.1@tcp:105: 00000100:00100000:0.0:1787853113.014347:0:5823:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f49065f7180 going to sleep for 11 seconds 00000100:00100000:0.0:1787853113.018704:0:5823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4921697840 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5823:1874699552366080:192.168.204.1@tcp:105: 00010000:00010000:0.0:1787853113.018735:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787853113.018811:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493c5a7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+6:2362:x1874699526128256:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 4754us (4981us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853113.018822:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 49 00000100:00100000:2.0:1787853113.022553:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853113.025654:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526128512 00000100:00100000:1.0:1787853113.025672:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526128512 00000100:00100000:1.0:1787853113.025773:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 25 00000100:00100000:1.0:1787853113.025788:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49342361c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+33:10523:x1874699526128512:12345-192.168.204.1@tcp:35:bash.0 00000100:00100000:1.0:1787853113.026378:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49342361c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+34:10523:x1874699526128512:12345-192.168.204.1@tcp:35:bash.0 Request processed in 593us (3832us total) trans 4294967377 rc 0/0 00000100:00100000:1.0:1787853113.026387:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 25 00000100:00080000:3.0:1787853113.026481:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787853113.129745:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787853113.158187:0:7641:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000100:00100000:3.0:1787853113.346301:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853113.346417:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526128640 00000100:00100000:2.0:1787853113.346428:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526128640 00000100:00100000:2.0:1787853113.346502:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 97 00000100:00100000:2.0:1787853113.346513:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493c5a5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+34:10539:x1874699526128640:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:2.0:1787853113.346539:0:8462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853113.346559:0:8462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8200/0x710df789068e68ad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c5079389784 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853113.346660:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9600/0x710df789068e68b4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853113.346674:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9600/0x710df789068e68b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853113.346696:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9600/0x710df789068e68b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787853113.346756:0:8462:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:2.0:1787853113.346775:0:8462:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787853113.346876:0:8462:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9600/0x710df789068e68b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853113.346902:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8200/0x710df789068e68ad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389784 expref: 36 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853113.346920:0:8462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9600/0x710df789068e68b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389784 expref: 35 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853113.346929:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8f491176b400) 00010000:00010000:2.0:1787853113.346931:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787853113.346935:0:8462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49415b9600, rc 0) 00000100:00100000:2.0:1787853113.347110:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493c5a5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+35:10539:x1874699526128640:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 597us (819us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853113.347117:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 97 00000100:00100000:2.0:1787853113.371538:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853113.371720:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526128896 00000100:00100000:3.0:1787853113.371730:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526128896 00000100:00100000:3.0:1787853113.371841:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 98 00000100:00100000:3.0:1787853113.371866:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4934236d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+35:10539:x1874699526128896:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:3.0:1787853113.371889:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853113.371911:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20e00/0x710df789068e68bb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c507938978b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853113.372024:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21c00/0x710df789068e68c2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853113.372040:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21c00/0x710df789068e68c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853113.372052:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21c00/0x710df789068e68c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787853113.372089:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1787853113.372230:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20e00/0x710df789068e68bb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c507938978b expref: 38 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853113.372250:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21c00/0x710df789068e68c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c507938978b expref: 37 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853113.372259:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8f4910aab600) 00010000:00010000:3.0:1787853113.372262:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787853113.372266:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4921e21c00, rc 0) 00000100:00100000:3.0:1787853113.372343:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4934236d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+37:10539:x1874699526128896:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 479us (816us total) trans 4294967378 rc 0/0 00000100:00100000:3.0:1787853113.372516:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 98 00000100:00100000:1.0:1787853113.386894:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853113.386964:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853113.386995:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526129024 00000100:00100000:2.0:1787853113.387004:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526129024 00000100:00100000:2.0:1787853113.387093:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 5 00000100:00100000:2.0:1787853113.387104:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4905684c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+37:2363:x1874699526129024:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787853113.387121:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787853113.387147:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21c00/0x710df789068e68c2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c507938978b expref: 37 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853113.387170:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8f4910aab600) 00010000:00010000:2.0:1787853113.387175:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787853113.387252:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4905684c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+36:2363:x1874699526129024:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 151us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853113.387266:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 5 00000100:00100000:0.0:1787853113.387383:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526129280 00000100:00100000:0.0:1787853113.387388:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526129280 00000100:00100000:0.0:1787853113.387426:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 99 00000100:00100000:0.0:1787853113.387433:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49031c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+36:10539:x1874699526129280:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:0.0:1787853113.387454:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853113.387469:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7400/0x710df789068e68d0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c5079389792 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853113.387607:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7e00/0x710df789068e68d7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853113.387622:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7e00/0x710df789068e68d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853113.387633:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7e00/0x710df789068e68d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787853113.387646:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1787853113.387781:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7400/0x710df789068e68d0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389792 expref: 39 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853113.387799:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7e00/0x710df789068e68d7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389792 expref: 38 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853113.387806:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8f4910aab600) 00010000:00010000:0.0:1787853113.387809:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787853113.387812:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49415b7e00, rc 0) 00000100:00100000:0.0:1787853113.387840:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49031c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+38:10539:x1874699526129280:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 407us (875us total) trans 4294967379 rc 0/0 00000100:00100000:0.0:1787853113.387846:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 99 00000100:00100000:1.0:1787853113.407227:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853113.407467:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526129408 00000100:00100000:2.0:1787853113.407478:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526129408 00000100:00100000:2.0:1787853113.407543:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 38 00000100:00100000:2.0:1787853113.407553:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49031c2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+6:2362:x1874699526129408:12345-192.168.204.1@tcp:1:lfs.0 00010000:00010000:2.0:1787853113.407656:0:6684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043610287/0x710df789068e68e5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853113.407683:0:6684:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a8864ad2/0x710df789068e68a6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.1@tcp remote: 0xd0a9c507938977d expref: 6 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853113.407694:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787853113.407699:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787853113.407704:0:6684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000043610287/0x710df789068e68e5 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853113.407741:0:6684:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a8864ad2/0x710df789068e68a6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.1@tcp remote: 0xd0a9c507938977d expref: 6 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853113.407755:0:6684:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a8864ad2/0x710df789068e68a6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.1@tcp remote: 0xd0a9c507938977d expref: 6 pid: 8463 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853113.407769:0:6684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4934235680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6684:1874699552366208:192.168.204.1@tcp:104: 00000100:00100000:2.0:1787853113.407866:0:6684:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f4904c000c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787853113.415285:0:6684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4934235680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6684:1874699552366208:192.168.204.1@tcp:104: 00010000:00010000:2.0:1787853113.415336:0:6684:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000043610287/0x710df789068e68e5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853113.415798:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853113.416462:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526129536 00000100:00100000:2.0:1787853113.416471:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526129536 00002000:00100000:2.0:1787853113.416523:0:6689:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff8f4904cd6940 x1874699526129536/t0(0) o4->b1d98f5a-0be0-4f69-83a6-833c935c8205@192.168.204.1@tcp:289/0 lens 504/0 e 0 to 0 dl 1787853124 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787853113.416534:0:6689:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff8f4904cd6940 with x1874699526129536 ext(0->8) 00010000:00010000:2.0:1787853113.416542:0:6689:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a8864ad2/0x710df789068e68a6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.1@tcp remote: 0xd0a9c507938977d expref: 7 pid: 8463 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853113.416557:0:6689:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a8864ad2/0x710df789068e68a6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.1@tcp remote: 0xd0a9c507938977d expref: 7 pid: 8463 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787853113.416566:0:6689:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8f4904cd6940 00000100:00100000:1.0:1787853113.417315:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 1 00000100:00100000:1.0:1787853113.417334:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4904cd6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+7:2363:x1874699526129536:12345-192.168.204.1@tcp:4:lfs.0 00000100:00100000:2.0:1787853113.417340:0:6689:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1787853113.417349:0:6689:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:1.0:1787853113.420528:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4904cd6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+9:2363:x1874699526129536:12345-192.168.204.1@tcp:4:lfs.0 Request processed in 3188us (4718us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1787853113.420547:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 1 00002000:00100000:1.0:1787853113.420563:0:6687:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff8f4904cd6940 x1874699526129536/t4294967302(0) o4->b1d98f5a-0be0-4f69-83a6-833c935c8205@192.168.204.1@tcp:289/0 lens 504/448 e 0 to 0 dl 1787853124 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787853113.420591:0:6687:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff8f4904cd6940 with x1874699526129536 ext(0->8) 00010000:00010000:1.0:1787853113.420604:0:6687:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a8864ad2/0x710df789068e68a6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.1@tcp remote: 0xd0a9c507938977d expref: 9 pid: 8463 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853113.420626:0:6687:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a8864ad2/0x710df789068e68a6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.1@tcp remote: 0xd0a9c507938977d expref: 9 pid: 8463 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787853113.420635:0:6687:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8f4904cd6940 00000100:00100000:1.0:1787853113.430908:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853113.432261:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526129664 00000100:00100000:3.0:1787853113.432275:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526129664 00010000:00010000:3.0:1787853113.432342:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a8864ad2/0x710df789068e68a6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.1@tcp remote: 0xd0a9c507938977d expref: 9 pid: 8463 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853113.432393:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 50 00000100:00100000:3.0:1787853113.432404:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4904cd6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+9:2362:x1874699526129664:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787853113.432420:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1787853113.432441:0:5822:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1787853113.432444:0:5822:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787853113 00002000:00010000:3.0:1787853113.432446:0:5822:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787853113 00002000:00010000:3.0:1787853113.432448:0:5822:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1787853113 00010000:00010000:3.0:1787853113.432455:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a8864ad2/0x710df789068e68a6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.1@tcp remote: 0xd0a9c507938977d expref: 9 pid: 8463 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853113.432470:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a8864ad2/0x710df789068e68a6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.1@tcp remote: 0xd0a9c507938977d expref: 9 pid: 8463 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853113.432495:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8864ad2/0x710df789068e68a6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.1@tcp remote: 0xd0a9c507938977d expref: 9 pid: 8463 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853113.432511:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787853113.432515:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787853113.432522:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000043610287/0x710df789068e68e5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853113.432532:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000043610287/0x710df789068e68e5 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853113.432613:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787853113.432680:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4904cd6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+8:2362:x1874699526129664:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 277us (1782us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853113.432688:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 50 00010000:00010000:2.0:1787853113.433229:0:6684:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000043610287/0x710df789068e68e5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853113.433240:0:6684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000043610287/0x710df789068e68e5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853113.433265:0:6684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043610287/0x710df789068e68e5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853113.433272:0:6684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000043610287/0x710df789068e68e5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853113.433288:0:6684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000043610287/0x710df789068e68e5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853113.433295:0:6684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b8200 already unused, calling callback (ffffffffc1528440) 00010000:00010000:2.0:1787853113.433298:0:6684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000043610287/0x710df789068e68e5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853113.433306:0:6684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000043610287/0x710df789068e68e5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853113.433322:0:6684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000043610287/0x710df789068e68e5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853113.433329:0:6684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000043610287/0x710df789068e68e5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853113.433393:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49031c2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+7:2362:x1874699526129408:12345-192.168.204.1@tcp:1:lfs.0 Request processed in 25841us (26178us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853113.433402:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 38 00000100:00100000:2.0:1787853113.440912:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853113.441356:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526129920 00000100:00100000:1.0:1787853113.441367:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526129920 00000100:00100000:1.0:1787853113.441428:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 26 00000100:00100000:1.0:1787853113.441438:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f491040bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+38:10539:x1874699526129920:12345-192.168.204.1@tcp:35:lfs.0 00000004:00010000:1.0:1787853113.441502:0:5839:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7e00/0x710df789068e68d7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389792 expref: 38 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787853113.441998:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:1.0:1787853113.443006:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:1.0:1787853113.444567:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:1.0:1787853113.444665:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad000/0x710df789068e68ec lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853113.444687:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9e00/0x710df789068e6891 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c507938976f expref: 42 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853113.444698:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad000/0x710df789068e68ec lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853113.444740:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9e00/0x710df789068e6891 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.1@tcp remote: 0xd0a9c507938976f expref: 42 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853113.444756:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9e00/0x710df789068e6891 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c507938976f expref: 42 pid: 5838 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853113.444771:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f493fd54f00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5839:1874699552366336:192.168.204.1@tcp:104: 00000100:00100000:1.0:1787853113.444870:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f4905074600 going to sleep for 11 seconds 00000100:00100000:2.0:1787853113.453953:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853113.454203:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526130048 00000100:00100000:0.0:1787853113.454213:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526130048 00010000:00010000:0.0:1787853113.454258:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9e00/0x710df789068e6891 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c507938976f expref: 43 pid: 5838 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853113.454303:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 51 00000100:00100000:0.0:1787853113.454327:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4934235680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+43:2363:x1874699526130048:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787853113.454344:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787853113.454352:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9e00/0x710df789068e6891 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c507938976f expref: 43 pid: 5838 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853113.454366:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9e00/0x710df789068e6891 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c507938976f expref: 43 pid: 5838 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853113.454392:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8f4910aab600) 00010000:00010000:0.0:1787853113.454398:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad000/0x710df789068e68ec lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853113.454408:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad000/0x710df789068e68ec lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853113.454415:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad000/0x710df789068e68ec lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853113.454433:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787853113.454496:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4934235680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+43:2363:x1874699526130048:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 171us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853113.454504:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 51 00010000:00010000:1.0:1787853113.455885:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9e00/0x710df789068e6891 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c507938976f expref: 42 pid: 5838 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853113.455911:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f493fd54f00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5839:1874699552366336:192.168.204.1@tcp:104: 00010000:00010000:1.0:1787853113.455938:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad000/0x710df789068e68ec lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853113.455949:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad000/0x710df789068e68ec lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853113.455956:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad000/0x710df789068e68ec lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787853113.456245:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:1.0:1787853113.456449:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:1.0:1787853113.456649:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f493fd54f00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5839:1874699552366464:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787853113.456724:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853113.456768:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f4905074e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787853113.457052:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552366464 00000100:00100000:2.0:1787853113.457060:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552366464 00000100:00100000:2.0:1787853113.457256:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787853113.457266:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493fd55680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5839:x1874699552366464:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00080000:3.0:1787853113.457641:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787853113.457725:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493fd55680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5839:x1874699552366464:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 461us (1001us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853113.457733:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787853113.462960:0:5839:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:0.0:1787853113.462975:0:5839:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:0.0:1787853113.462999:0:5839:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8f494159c000, transno 4294967301 00000100:00100000:0.0:1787853113.463033:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f493fd54f00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5839:1874699552366464:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1787853113.464320:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:0.0:1787853113.464409:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4921697840 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5839:1874699552366592:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787853113.464501:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853113.464543:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f49065f7300 going to sleep for 11 seconds 00000100:00100000:1.0:1787853113.464766:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552366592 00000100:00100000:1.0:1787853113.464775:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552366592 00000100:00100000:1.0:1787853113.464820:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787853113.464830:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4921697480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5839:x1874699552366592:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787853113.465015:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4921697480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5839:x1874699552366592:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 174us (503us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1787853113.465023:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787853113.465321:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4921697840 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5839:1874699552366592:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1787853113.465384:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:0.0:1787853113.465422:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad000/0x710df789068e68ec lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853113.465432:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad000/0x710df789068e68ec lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853113.465439:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad000/0x710df789068e68ec lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853113.465446:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f492a8ad000 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:0.0:1787853113.465450:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad000/0x710df789068e68ec lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853113.465458:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad000/0x710df789068e68ec lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853113.465476:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8f4910aab600) 00010000:00010000:0.0:1787853113.465479:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1787853113.465484:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad000/0x710df789068e68ec lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853113.465491:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad000/0x710df789068e68ec lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787853113.465969:0:5839:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1787853113.466463:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:0.0:1787853113.466477:0:5839:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 433007905719ns, next at 434007903218ns, rc = 0 00000001:00080000:0.0:1787853113.466498:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:0.0:1787853113.466541:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8f4910aab600) 00010000:00010000:0.0:1787853113.466545:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787853113.466553:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7e00/0x710df789068e68d7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389792 expref: 46 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853113.466720:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f491040bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+45:10539:x1874699526129920:12345-192.168.204.1@tcp:35:lfs.0 Request processed in 25282us (25819us total) trans 4294967388 rc 0/0 00000100:00100000:0.0:1787853113.466729:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 26 00000020:00080000:0.0:1787853113.466734:0:5839:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1787853113.470494:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853113.470609:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526130176 00000100:00100000:0.0:1787853113.470619:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526130176 00000100:00100000:0.0:1787853113.470680:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 100 00000100:00100000:0.0:1787853113.470700:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4934236940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+45:10539:x1874699526130176:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:0.0:1787853113.470724:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853113.470748:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7400/0x710df789068e68f3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c5079389799 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853113.470811:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7400/0x710df789068e68f3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389799 expref: 46 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853113.470827:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7400/0x710df789068e68f3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389799 expref: 46 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853113.470846:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8f491176b200) 00010000:00010000:0.0:1787853113.470849:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787853113.470853:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49415b7400, rc 0) 00000100:00100000:0.0:1787853113.470909:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4934236940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+46:10539:x1874699526130176:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 220us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853113.470931:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 100 00000100:00100000:2.0:1787853113.482725:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853113.482872:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526130432 00000100:00100000:3.0:1787853113.482882:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526130432 00000100:00100000:3.0:1787853113.482947:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 27 00000100:00100000:3.0:1787853113.482962:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4934237480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+46:10539:x1874699526130432:12345-192.168.204.1@tcp:35:lfs.0 00000100:00100000:3.0:1787853113.483325:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4934237480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+47:10539:x1874699526130432:12345-192.168.204.1@tcp:35:lfs.0 Request processed in 369us (610us total) trans 4294967389 rc 0/0 00000100:00100000:3.0:1787853113.483333:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 27 00000100:00100000:2.0:1787853113.595884:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853113.596049:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526130560 00000100:00100000:0.0:1787853113.596069:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526130560 00000100:00100000:0.0:1787853113.596334:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 101 00000100:00100000:0.0:1787853113.596345:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4934234f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+47:10549:x1874699526130560:12345-192.168.204.1@tcp:34:lfs.0 00010000:00010000:0.0:1787853113.596432:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7e00/0x710df789068e68fa lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853113.596451:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7e00/0x710df789068e68fa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853113.596465:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7e00/0x710df789068e68fa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853113.596483:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e6901 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853113.596489:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e6901 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853113.596495:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e6901 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853113.596674:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e6908 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853113.596695:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e6908 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853113.596704:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e6908 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787853113.596770:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e6908 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853113.596784:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7e00/0x710df789068e68fa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853113.596791:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7e00/0x710df789068e68fa lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853113.596799:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7e00/0x710df789068e68fa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853113.598033:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b7e00 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:0.0:1787853113.598040:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7e00/0x710df789068e68fa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853113.598052:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7e00/0x710df789068e68fa lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853113.598213:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8f491176b400) 00010000:00010000:0.0:1787853113.598218:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787853113.598224:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7e00/0x710df789068e68fa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853113.598232:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7e00/0x710df789068e68fa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853113.598253:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e6901 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853113.598260:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e6901 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853113.598281:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e6901 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853113.598287:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b6200 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:0.0:1787853113.598290:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e6901 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853113.598297:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e6901 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853113.598305:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8f491176b500) 00010000:00010000:0.0:1787853113.598308:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787853113.598311:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e6901 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853113.598318:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e6901 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853113.598335:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e6908 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853113.598341:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e6908 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853113.598347:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e6908 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853113.598353:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b7c00 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:0.0:1787853113.598356:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e6908 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853113.598372:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e6908 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853113.598380:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8f491176b200) 00010000:00010000:0.0:1787853113.598382:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787853113.598385:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e6908 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853113.598391:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e6908 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853113.598791:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4934234f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+47:10549:x1874699526130560:12345-192.168.204.1@tcp:34:lfs.0 Request processed in 2442us (2912us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853113.598802:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 101 00000100:00100000:2.0:1787853113.668479:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853113.668537:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853113.668617:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853113.668657:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853113.668738:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526130944 00000100:00100000:0.0:1787853113.668748:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526130944 00000100:00100000:0.0:1787853113.668800:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526130816 00000100:00100000:0.0:1787853113.668803:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526130816 00000100:00100000:1.0:1787853113.668911:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526130688 00000100:00100000:1.0:1787853113.668915:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526130688 00000100:00100000:1.0:1787853113.668948:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 296 00000100:00100000:1.0:1787853113.668958:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4906232c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af755b38-4932-400a-92cc-ddad0ca077a5+13:2364:x1874699526130688:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:1.0:1787853113.669041:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4906232c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af755b38-4932-400a-92cc-ddad0ca077a5+13:2364:x1874699526130688:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 84us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853113.669049:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 296 00000100:00100000:0.0:1787853113.669785:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 87 00000100:00100000:0.0:1787853113.669801:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4934234000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+7:2364:x1874699526130944:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:0.0:1787853113.669854:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4934234000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+7:2364:x1874699526130944:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 60us (1317us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853113.669861:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 87 00000100:00100000:0.0:1787853113.669877:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 88 00000100:00100000:0.0:1787853113.669884:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49342370c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+6:2364:x1874699526130816:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:0.0:1787853113.669923:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49342370c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+6:2364:x1874699526130816:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 39us (1317us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853113.669951:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 88 00000100:00080000:3.0:1787853113.670247:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787853113.670281:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526131072 00000100:00100000:3.0:1787853113.670287:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526131072 00000100:00100000:3.0:1787853113.670334:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 155 00000100:00100000:3.0:1787853113.670342:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49342361c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ea3b4e1-e827-460f-be07-19e86dff3d79+5:2364:x1874699526131072:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:3.0:1787853113.670374:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49342361c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ea3b4e1-e827-460f-be07-19e86dff3d79+5:2364:x1874699526131072:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 34us (1717us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853113.670381:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 155 00000100:00080000:3.0:1787853113.670401:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787853113.692205:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853113.692370:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526131328 00000100:00100000:2.0:1787853113.692379:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526131328 00000100:00100000:2.0:1787853113.692491:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 102 00000100:00100000:2.0:1787853113.692503:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493c5a4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+47:10552:x1874699526131328:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:2.0:1787853113.692526:0:8462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853113.692550:0:8462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8a00/0x710df789068e690f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c50793897a0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853113.692674:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8600/0x710df789068e6916 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853113.692701:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8600/0x710df789068e6916 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853113.692713:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8600/0x710df789068e6916 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853113.692731:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8000/0x710df789068e691d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853113.692763:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8000/0x710df789068e691d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853113.692770:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8000/0x710df789068e691d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853113.693056:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e6924 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853113.693066:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e6924 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853113.693147:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e6924 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787853113.693159:0:8462:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1787853113.693259:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8600/0x710df789068e6916 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853113.693267:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8600/0x710df789068e6916 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853113.693273:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8600/0x710df789068e6916 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853113.693279:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b8600 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:2.0:1787853113.693283:0:8462:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8600/0x710df789068e6916 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853113.693291:0:8462:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8600/0x710df789068e6916 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853113.693316:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8f491176b400) 00010000:00010000:2.0:1787853113.693319:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787853113.693324:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8600/0x710df789068e6916 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853113.693330:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8600/0x710df789068e6916 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853113.693346:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8000/0x710df789068e691d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853113.693353:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8000/0x710df789068e691d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853113.693358:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8000/0x710df789068e691d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853113.693363:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b8000 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:2.0:1787853113.693365:0:8462:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8000/0x710df789068e691d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853113.693371:0:8462:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8000/0x710df789068e691d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853113.693378:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8f4910aaba00) 00010000:00010000:2.0:1787853113.693381:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787853113.693384:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8000/0x710df789068e691d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853113.693388:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8000/0x710df789068e691d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853113.693442:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8a00/0x710df789068e690f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793897a0 expref: 50 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853113.693456:0:8462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e6924 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793897a0 expref: 49 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853113.693463:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8f491176b200) 00010000:00010000:2.0:1787853113.693465:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787853113.693468:0:8462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49415b8c00, rc 0) 00000100:00100000:2.0:1787853113.693546:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493c5a4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+49:10552:x1874699526131328:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 1045us (1352us total) trans 4294967390 rc 0/0 00000100:00100000:2.0:1787853113.693554:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 102 00000100:00100000:3.0:1787853113.699051:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853113.699512:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526131456 00000100:00100000:0.0:1787853113.699522:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526131456 00000100:00100000:0.0:1787853113.699628:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 103 00000100:00100000:0.0:1787853113.699638:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493c5a6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+49:10552:x1874699526131456:12345-192.168.204.1@tcp:54:lfs.0 00010000:00010000:0.0:1787853113.699720:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e6932 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853113.699738:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e6932 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853113.699750:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e6932 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853113.699777:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e6932 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853113.699784:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e6932 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853113.699790:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e6932 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853113.699797:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b7c00 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:0.0:1787853113.699808:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e6932 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853113.699816:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e6932 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853113.699829:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8f491176b200) 00010000:00010000:0.0:1787853113.699849:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787853113.699855:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e6932 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853113.699861:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e6932 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853113.699947:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493c5a6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+49:10552:x1874699526131456:12345-192.168.204.1@tcp:54:lfs.0 Request processed in 310us (904us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853113.699955:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 103 00000100:00100000:3.0:1787853113.704067:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853113.705249:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526131712 00000100:00100000:1.0:1787853113.705262:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526131712 00000100:00100000:1.0:1787853113.705327:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 28 00000100:00100000:1.0:1787853113.705337:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493c5a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+49:10552:x1874699526131712:12345-192.168.204.1@tcp:35:lfs.0 00000100:00100000:1.0:1787853113.705564:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493c5a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+50:10552:x1874699526131712:12345-192.168.204.1@tcp:35:lfs.0 Request processed in 228us (1506us total) trans 4294967391 rc 0/0 00000100:00100000:1.0:1787853113.705772:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 28 00000100:00100000:2.0:1787853113.852082:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853113.852236:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526131968 00000100:00100000:0.0:1787853113.852246:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526131968 00000100:00100000:0.0:1787853113.852308:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 104 00000100:00100000:0.0:1787853113.852318:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4941740780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+50:10562:x1874699526131968:12345-192.168.204.1@tcp:101:bash.0 00010000:00010000:0.0:1787853113.852342:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853113.852346:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787853113.852376:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9600/0x710df789068e68b4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389784 expref: 50 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853113.852397:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8f491176b400) 00010000:00010000:0.0:1787853113.852402:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787853113.852415:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e6939 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c50793897a7 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853113.852522:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e6940 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853113.852535:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e6940 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853113.852566:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e6940 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787853113.852651:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1787853113.853466:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e6939 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793897a7 expref: 52 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853113.853490:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e6940 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793897a7 expref: 51 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853113.853498:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8f491176b200) 00010000:00010000:0.0:1787853113.853500:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787853113.853503:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49415b6200, rc 0) 00000100:00100000:0.0:1787853113.853673:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4941740780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+51:10562:x1874699526131968:12345-192.168.204.1@tcp:101:bash.0 Request processed in 1356us (1609us total) trans 4294967392 rc 0/0 00000100:00100000:0.0:1787853113.853692:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 104 00000100:00100000:3.0:1787853113.872214:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853113.872339:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853113.875527:0:11175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526132096 00000100:00100000:2.0:1787853113.875546:0:11175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526132096 00000100:00100000:0.0:1787853113.875599:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526132352 00000100:00100000:0.0:1787853113.875606:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526132352 00000100:00100000:0.0:1787853113.875666:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 105 00000100:00100000:0.0:1787853113.875677:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49056df0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+52:10562:x1874699526132352:12345-192.168.204.1@tcp:36:bash.0 00000100:00100000:2.0:1787853113.875709:0:11175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 6 00000100:00100000:2.0:1787853113.875720:0:11175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49056dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b1d98f5a-0be0-4f69-83a6-833c935c8205+52:2362:x1874699526132096:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787853113.875732:0:11175:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787853113.875735:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787853113.875761:0:11175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e6940 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793897a7 expref: 52 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853113.877323:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e6924 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793897a0 expref: 51 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853113.877349:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8f491176b200) 00010000:00010000:0.0:1787853113.877355:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787853113.877694:0:11175:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8f491176b200) 00010000:00010000:2.0:1787853113.877700:0:11175:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787853113.878008:0:11175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49056dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b1d98f5a-0be0-4f69-83a6-833c935c8205+51:2362:x1874699526132096:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 2278us (5793us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853113.878019:0:11175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 6 00010000:00010000:0.0:1787853113.880438:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e694e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853113.880465:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e694e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853113.880478:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e694e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787853113.880719:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:0.0:1787853113.880769:0:5838:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d1e423ca reply state 00000000f5282f4b transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e694e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853113.880779:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787853113.881122:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49056df0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+52:10562:x1874699526132352:12345-192.168.204.1@tcp:36:bash.0 Request processed in 5442us (8778us total) trans 4294967394 rc 0/0 00000100:00100000:0.0:1787853113.881132:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 105 00000020:00080000:0.0:1787853113.881139:0:5838:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787853113.885629:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e694e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853113.885658:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e694e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853113.885666:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e694e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853113.885673:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b7c00 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:0.0:1787853113.885687:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e694e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853113.885696:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e694e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853113.885740:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8f491176b200) 00010000:00010000:0.0:1787853113.885744:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787853113.885750:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e694e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853113.885757:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e694e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853113.889263:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853113.889413:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526132480 00000100:00100000:2.0:1787853113.889423:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526132480 00000100:00100000:2.0:1787853113.889488:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 106 00000100:00100000:2.0:1787853113.889500:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49056dd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+51:10562:x1874699526132480:12345-192.168.204.1@tcp:101:bash.0 00010000:00010000:2.0:1787853113.889527:0:8462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853113.889550:0:8462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8000/0x710df789068e6955 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c50793897ae expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853113.889895:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8600/0x710df789068e695c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853113.889910:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8600/0x710df789068e695c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853113.889922:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8600/0x710df789068e695c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787853113.889951:0:8462:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1787853113.889955:0:8462:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787853113.889974:0:8462:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8600/0x710df789068e695c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853113.890238:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8000/0x710df789068e6955 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793897ae expref: 53 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853113.890261:0:8462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8600/0x710df789068e695c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793897ae expref: 52 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853113.890269:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8f491176b200) 00010000:00010000:2.0:1787853113.890271:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787853113.890284:0:8462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49415b8600, rc 0) 00000100:00100000:2.0:1787853113.890363:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49056dd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+52:10562:x1874699526132480:12345-192.168.204.1@tcp:101:bash.0 Request processed in 866us (1109us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853113.890371:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 106 00000100:00100000:3.0:1787853113.895752:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853113.905315:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526132736 00000100:00100000:0.0:1787853113.905332:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526132736 00000100:00100000:0.0:1787853113.906338:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 29 00000100:00100000:0.0:1787853113.907414:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49056de940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+52:10562:x1874699526132736:12345-192.168.204.1@tcp:35:bash.0 00000100:00100000:0.0:1787853113.907707:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49056de940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+53:10562:x1874699526132736:12345-192.168.204.1@tcp:35:bash.0 Request processed in 306us (11963us total) trans 4294967395 rc 0/0 00000100:00100000:0.0:1787853113.907716:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 29 00000100:00100000:3.0:1787853114.040965:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853114.042788:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526132864 00000100:00100000:0.0:1787853114.042808:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526132864 00000100:00100000:0.0:1787853114.042912:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 107 00000100:00100000:0.0:1787853114.042923:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49056dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+53:10568:x1874699526132864:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:0.0:1787853114.042955:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853114.042983:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e6963 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c50793897b5 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853114.043058:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7e00/0x710df789068e696a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853114.043085:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7e00/0x710df789068e696a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853114.043120:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7e00/0x710df789068e696a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787853114.043201:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:0.0:1787853114.043205:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787853114.043228:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7e00/0x710df789068e696a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853114.043256:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e6963 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793897b5 expref: 55 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853114.043280:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7e00/0x710df789068e696a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793897b5 expref: 54 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853114.043288:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8f491176b400) 00010000:00010000:0.0:1787853114.043291:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787853114.043295:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49415b7e00, rc 0) 00000100:00100000:0.0:1787853114.043372:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49056dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+54:10568:x1874699526132864:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 450us (2428us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853114.043379:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 107 00000100:00100000:3.0:1787853114.048624:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853114.048761:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526132992 00000100:00100000:0.0:1787853114.048771:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526132992 00000100:00100000:0.0:1787853114.048839:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 108 00000100:00100000:0.0:1787853114.048850:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49056dde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+54:10568:x1874699526132992:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:0.0:1787853114.048875:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853114.048897:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6600/0x710df789068e6971 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c50793897bc expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853114.048985:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7200/0x710df789068e6978 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853114.048999:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7200/0x710df789068e6978 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853114.049010:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7200/0x710df789068e6978 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853114.049025:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6a00/0x710df789068e697f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853114.049032:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6a00/0x710df789068e697f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853114.049039:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6a00/0x710df789068e697f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853114.049170:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6800/0x710df789068e6986 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853114.049179:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6800/0x710df789068e6986 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853114.049187:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6800/0x710df789068e6986 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787853114.049226:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1787853114.049230:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787853114.049249:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6800/0x710df789068e6986 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853114.049272:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6800/0x710df789068e6986 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853114.049281:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7200/0x710df789068e6978 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853114.049288:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7200/0x710df789068e6978 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853114.049295:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7200/0x710df789068e6978 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853114.049302:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b7200 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:0.0:1787853114.049306:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7200/0x710df789068e6978 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853114.049315:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7200/0x710df789068e6978 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853114.049328:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8f491176b400) 00010000:00010000:0.0:1787853114.049332:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787853114.049343:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7200/0x710df789068e6978 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853114.049350:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7200/0x710df789068e6978 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853114.049366:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6a00/0x710df789068e697f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853114.049372:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6a00/0x710df789068e697f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853114.049399:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6a00/0x710df789068e697f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853114.049404:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b6a00 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:0.0:1787853114.049407:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6a00/0x710df789068e697f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853114.049414:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6a00/0x710df789068e697f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853114.049423:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8f491176b500) 00010000:00010000:0.0:1787853114.049426:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787853114.049429:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6a00/0x710df789068e697f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853114.049435:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6a00/0x710df789068e697f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853114.049467:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6600/0x710df789068e6971 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793897bc expref: 56 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853114.049481:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6800/0x710df789068e6986 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793897bc expref: 55 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853114.049489:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8f491176b200) 00010000:00010000:0.0:1787853114.049491:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787853114.049494:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49415b6800, rc 0) 00000100:00100000:0.0:1787853114.049561:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49056dde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+55:10568:x1874699526132992:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 713us (991us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853114.049608:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 108 00000100:00100000:3.0:1787853114.055731:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853114.056061:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526133248 00000100:00100000:0.0:1787853114.056081:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526133248 00000100:00100000:0.0:1787853114.056155:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 109 00000100:00100000:0.0:1787853114.056165:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49056dcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+55:10568:x1874699526133248:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:0.0:1787853114.056187:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853114.056212:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e698d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c50793897c3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853114.056323:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6400/0x710df789068e6994 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853114.056337:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8600/0x710df789068e695c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793897ae expref: 56 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853114.056346:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6800/0x710df789068e6986 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793897bc expref: 56 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853114.056354:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6400/0x710df789068e6994 lrc: 5/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853114.056403:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6800/0x710df789068e6986 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793897bc expref: 56 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853114.056417:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6800/0x710df789068e6986 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793897bc expref: 56 pid: 5837 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853114.056432:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4921694f00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5838:1874699552366720:192.168.204.1@tcp:104: 00010000:00010000:0.0:1787853114.056564:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8600/0x710df789068e695c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793897ae expref: 56 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853114.056603:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8600/0x710df789068e695c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793897ae expref: 56 pid: 8462 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853114.056612:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49031c2940 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5838:1874699552366848:192.168.204.1@tcp:104: 00000100:00100000:0.0:1787853114.056642:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f49065f7180 going to sleep for 11 seconds 00000100:00100000:2.0:1787853114.067463:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853114.067525:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526133376 00000100:00100000:3.0:1787853114.067536:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526133376 00010000:00010000:3.0:1787853114.068084:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6800/0x710df789068e6986 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793897bc expref: 57 pid: 5837 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853114.068177:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 52 00000100:00100000:3.0:1787853114.068191:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493bee9e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+57:2362:x1874699526133376:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787853114.068210:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787853114.068218:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6800/0x710df789068e6986 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793897bc expref: 57 pid: 5837 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853114.068234:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00010000:00010000:3.0:1787853114.068236:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6800/0x710df789068e6986 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793897bc expref: 57 pid: 5837 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853114.068273:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8f491176b200) 00010000:00010000:3.0:1787853114.068279:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6400/0x710df789068e6994 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853114.068289:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6400/0x710df789068e6994 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853114.068296:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787853114.068357:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493bee9e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+57:2362:x1874699526133376:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 170us (905us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853114.068384:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 52 00000100:00100000:0.0:1787853114.075300:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49031c2940 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5838:1874699552366848:192.168.204.1@tcp:104: 00010000:00010000:0.0:1787853114.075947:0:5838:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.204.1@tcp) returned -22 from blocking AST (req@00000000ac6234f1 x1874699552366720) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6800/0x710df789068e6986 lrc: 1/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793897bc expref: 56 pid: 5837 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853114.075969:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6800/0x710df789068e6986 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793897bc expref: 56 pid: 5837 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853114.075991:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4921694f00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5838:1874699552366720:192.168.204.1@tcp:104: 00010000:00010000:0.0:1787853114.076099:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8f491176b200) 00010000:00010000:0.0:1787853114.076114:0:5838:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6400/0x710df789068e6994 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853114.076540:0:5838:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6400/0x710df789068e6994 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853114.076553:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6400/0x710df789068e6994 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853114.078705:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526133504 00000100:00100000:3.0:1787853114.078721:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526133504 00010000:00010000:3.0:1787853114.078773:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8600/0x710df789068e695c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793897ae expref: 56 pid: 8462 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853114.078932:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 53 00000100:00100000:0.0:1787853114.078959:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493beea580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+56:2362:x1874699526133504:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787853114.078979:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787853114.078987:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8600/0x710df789068e695c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793897ae expref: 56 pid: 8462 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853114.079001:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8600/0x710df789068e695c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793897ae expref: 56 pid: 8462 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853114.079027:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8600/0x710df789068e695c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793897ae expref: 56 pid: 8462 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853114.079045:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8f491176b200) 00010000:00010000:0.0:1787853114.079051:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6400/0x710df789068e6994 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853114.079060:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6400/0x710df789068e6994 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853114.079079:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6400/0x710df789068e6994 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853114.079117:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787853114.079124:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6400/0x710df789068e6994 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853114.079135:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6400/0x710df789068e6994 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787853114.079156:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1787853114.079395:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e698d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793897c3 expref: 57 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853114.079412:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6400/0x710df789068e6994 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793897c3 expref: 56 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853114.079419:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8f491176b200) 00010000:00010000:1.0:1787853114.079422:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787853114.079424:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49415b6400, rc 0) 00000100:00100000:1.0:1787853114.079482:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49056dcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+56:10568:x1874699526133248:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 23318us (23763us total) trans 4294967396 rc 0/0 00000100:00100000:1.0:1787853114.079490:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 109 00000100:00100000:0.0:1787853114.080526:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493beea580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+55:2362:x1874699526133504:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 1558us (12283us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853114.080537:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 53 00000100:00100000:0.0:1787853114.086532:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853114.086630:0:11175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526133760 00000100:00100000:3.0:1787853114.086640:0:11175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526133760 00000100:00100000:3.0:1787853114.086715:0:11175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 7 00000100:00100000:3.0:1787853114.086728:0:11175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49031c2940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b1d98f5a-0be0-4f69-83a6-833c935c8205+55:10568:x1874699526133760:12345-192.168.204.1@tcp:103:lfs.0 00010000:00010000:3.0:1787853114.086745:0:11175:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787853114.086772:0:11175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7400/0x710df789068e68f3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389799 expref: 55 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853114.087036:0:11175:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8f491176b200) 00010000:00010000:3.0:1787853114.087043:0:11175:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787853114.087114:0:11175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49031c2940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b1d98f5a-0be0-4f69-83a6-833c935c8205+54:10568:x1874699526133760:12345-192.168.204.1@tcp:103:lfs.0 Request processed in 389us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853114.087122:0:11175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 7 00000100:00100000:2.0:1787853114.091327:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853114.094100:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526133888 00000100:00100000:0.0:1787853114.094227:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526133888 00000100:00100000:1.0:1787853114.094392:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 110 00000100:00100000:1.0:1787853114.094404:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49065d6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+54:10568:x1874699526133888:12345-192.168.204.1@tcp:58:lfs.0 00010000:00010000:1.0:1787853114.094538:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ada00/0x710df789068e69a2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853114.094556:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ada00/0x710df789068e69a2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853114.094762:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ada00/0x710df789068e69a2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787853114.094951:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:1.0:1787853114.095043:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49065d6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+54:10568:x1874699526133888:12345-192.168.204.1@tcp:58:lfs.0 Request processed in 640us (3726us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853114.095051:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 110 00000100:00100000:2.0:1787853114.101089:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853114.101228:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526134016 00000100:00100000:3.0:1787853114.101238:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526134016 00000100:00100000:3.0:1787853114.101297:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 111 00000100:00100000:3.0:1787853114.101307:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4914199a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+54:10568:x1874699526134016:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:3.0:1787853114.101328:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853114.101348:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20e00/0x710df789068e69a9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c50793897ca expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853114.101442:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ada00/0x710df789068e69a2 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853114.101453:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20e00/0x710df789068e69a9 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793897ca expref: 55 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853114.101473:0:5836:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ada00/0x710df789068e69a2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853114.101486:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20e00/0x710df789068e69a9 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793897ca expref: 55 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853114.101498:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8f491176b200) 00010000:00010000:3.0:1787853114.101501:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787853114.101505:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20e00/0x710df789068e69a9 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793897ca expref: 55 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853114.101513:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4921e20e00, rc 0) 00000100:00100000:3.0:1787853114.101621:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4914199a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+55:10568:x1874699526134016:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 314us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853114.101629:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 111 00010000:00010000:2.0:1787853114.154638:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787853114.731515:0:11690:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787853114.731528:0:11690:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787853114.731611:0:11690:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:2.0:1787853114.731620:0:11690:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787853114.731760:0:11690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f491419a940 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11690:1874699552366976:192.168.204.1@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787853114.731858:0:11690:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f4904c00f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787853114.738272:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853114.738394:0:11690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f491419a940 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11690:1874699552366976:192.168.204.1@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787853114.738623:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526134144 00000100:00100000:1.0:1787853114.738631:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526134144 00000100:00100000:1.0:1787853114.738696:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 112 00000100:00100000:1.0:1787853114.738706:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4914199680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+55:10569:x1874699526134144:12345-192.168.204.1@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787853114.738737:0:5837:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787853114.738831:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4914199680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+55:10569:x1874699526134144:12345-192.168.204.1@tcp:53:lhsmtool_posix.0 Request processed in 126us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853114.738840:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 112 00000100:00100000:0.0:1787853114.747696:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853114.748773:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526134272 00000100:00100000:3.0:1787853114.748788:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526134272 00000100:00100000:3.0:1787853114.748862:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 113 00000100:00100000:3.0:1787853114.748874:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49031c30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+55:10569:x1874699526134272:12345-192.168.204.1@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787853114.748969:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21800/0x710df789068e69b0 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853114.748987:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21800/0x710df789068e69b0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853114.749001:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21800/0x710df789068e69b0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853114.749065:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20200/0x710df789068e69b7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853114.749074:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20200/0x710df789068e69b7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853114.749081:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20200/0x710df789068e69b7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853114.749103:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21c00/0x710df789068e69be lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853114.749111:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21c00/0x710df789068e69be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853114.749116:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21c00/0x710df789068e69be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787853114.749152:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1787853114.749155:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787853114.749166:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21c00/0x710df789068e69be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853114.749176:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21800/0x710df789068e69b0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853114.749187:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21800/0x710df789068e69b0 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853114.749194:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21800/0x710df789068e69b0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853114.749200:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4921e21800 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:3.0:1787853114.749205:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21800/0x710df789068e69b0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853114.749212:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21800/0x710df789068e69b0 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853114.749223:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f4914d11600) 00010000:00010000:3.0:1787853114.749226:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787853114.749230:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21800/0x710df789068e69b0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853114.749237:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21800/0x710df789068e69b0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853114.749251:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20200/0x710df789068e69b7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853114.749257:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20200/0x710df789068e69b7 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853114.749262:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20200/0x710df789068e69b7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853114.749268:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4921e20200 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:3.0:1787853114.749276:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20200/0x710df789068e69b7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853114.749294:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20200/0x710df789068e69b7 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853114.749302:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff8f4910f92000) 00010000:00010000:3.0:1787853114.749304:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787853114.749307:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20200/0x710df789068e69b7 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853114.749313:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20200/0x710df789068e69b7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853114.749327:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21c00/0x710df789068e69be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853114.749333:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21c00/0x710df789068e69be lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853114.749339:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21c00/0x710df789068e69be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853114.749344:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4921e21c00 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:3.0:1787853114.749346:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21c00/0x710df789068e69be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853114.749352:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21c00/0x710df789068e69be lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853114.749358:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8f491176b200) 00010000:00010000:3.0:1787853114.749359:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787853114.749368:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21c00/0x710df789068e69be lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853114.749375:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21c00/0x710df789068e69be lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853114.749458:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49031c30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+55:10569:x1874699526134272:12345-192.168.204.1@tcp:34:lhsmtool_posix.0 Request processed in 585us (1772us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853114.749466:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 113 00000100:00100000:0.0:1787853114.771554:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853114.777776:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526134528 00000100:00100000:1.0:1787853114.777794:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526134528 00000100:00100000:1.0:1787853114.777893:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 114 00000100:00100000:1.0:1787853114.777904:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4921694f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+55:10569:x1874699526134528:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787853114.777925:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853114.777952:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad600/0x710df789068e69c5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c50793897d1 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853114.778071:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad000/0x710df789068e69cc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853114.778086:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad000/0x710df789068e69cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853114.778115:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad000/0x710df789068e69cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787853114.778128:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1787853114.778232:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad000/0x710df789068e69cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853114.778240:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad000/0x710df789068e69cc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853114.778248:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad000/0x710df789068e69cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853114.778255:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f492a8ad000 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:1.0:1787853114.778259:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad000/0x710df789068e69cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853114.778266:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad000/0x710df789068e69cc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853114.778748:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8f491176b200) 00010000:00010000:1.0:1787853114.778753:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787853114.778759:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad000/0x710df789068e69cc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853114.778767:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad000/0x710df789068e69cc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853114.778824:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad600/0x710df789068e69c5 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793897d1 expref: 57 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853114.778852:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f4914d11600) 00010000:00010000:1.0:1787853114.778854:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787853114.778858:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad600/0x710df789068e69c5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793897d1 expref: 57 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853114.778867:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f492a8ad600, rc 0) 00000100:00100000:1.0:1787853114.778990:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4921694f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+56:10569:x1874699526134528:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 Request processed in 1087us (7446us total) trans 4294967397 rc 301/301 00000100:00100000:1.0:1787853114.778999:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 114 00000100:00100000:2.0:1787853114.801695:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853114.801826:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526134656 00000100:00100000:3.0:1787853114.801837:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526134656 00000100:00100000:3.0:1787853114.801905:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 115 00000100:00100000:3.0:1787853114.801915:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f491419b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+56:10569:x1874699526134656:12345-192.168.204.1@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787853114.801954:0:5836:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787853114.802071:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f491419b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+56:10569:x1874699526134656:12345-192.168.204.1@tcp:53:lhsmtool_posix.0 Request processed in 140us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853114.802079:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 115 00000100:00100000:0.0:1787853114.809444:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853114.809551:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526134912 00000100:00100000:2.0:1787853114.809561:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526134912 00000100:00100000:2.0:1787853114.809670:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 116 00000100:00100000:2.0:1787853114.809680:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4910d26d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+56:10569:x1874699526134912:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787853114.809702:0:8462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853114.809706:0:8462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787853114.809735:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7e00/0x710df789068e696a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793897b5 expref: 56 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853114.809757:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8f491176b400) 00010000:00010000:2.0:1787853114.809762:0:8462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787853114.809786:0:8462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9c00/0x710df789068e69da lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c50793897d8 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787853114.810228:0:8462:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:2.0:1787853114.810432:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8800/0x710df789068e69e1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853114.810446:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8800/0x710df789068e69e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853114.810457:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8800/0x710df789068e69e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853114.810511:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9c00/0x710df789068e69da lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793897d8 expref: 58 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853114.810527:0:8462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8800/0x710df789068e69e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793897d8 expref: 57 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853114.810536:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8f4910aaba00) 00010000:00010000:2.0:1787853114.810539:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787853114.810541:0:8462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49415b8800, rc 0) 00000100:00100000:2.0:1787853114.810653:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4910d26d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+57:10569:x1874699526134912:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 Request processed in 973us (1220us total) trans 4294967398 rc 0/0 00000100:00100000:2.0:1787853114.810661:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 116 00000100:00100000:0.0:1787853114.817183:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853114.817272:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526135168 00000100:00100000:3.0:1787853114.817283:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526135168 00000100:00100000:3.0:1787853114.817346:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 117 00000100:00100000:3.0:1787853114.817357:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4910d27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+57:10569:x1874699526135168:12345-192.168.204.1@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787853114.817419:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787853114.817447:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8800/0x710df789068e69e1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793897d8 expref: 57 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853114.817469:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8f4910aaba00) 00010000:00010000:3.0:1787853114.817480:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787853114.817505:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21c00/0x710df789068e69ef lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853114.817532:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21c00/0x710df789068e69ef lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853114.817543:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21c00/0x710df789068e69ef lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853114.819885:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20200/0x710df789068e69f6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xa9ac69f5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853114.819907:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20200/0x710df789068e69f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xa9ac69f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853114.819920:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20200/0x710df789068e69f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xa9ac69f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853114.820007:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21c00/0x710df789068e69ef lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853114.820014:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21c00/0x710df789068e69ef lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853114.820021:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21c00/0x710df789068e69ef lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853114.820026:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4921e21c00 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:3.0:1787853114.820030:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21c00/0x710df789068e69ef lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853114.820037:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21c00/0x710df789068e69ef lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853114.820048:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8f491176b400) 00010000:00010000:3.0:1787853114.820076:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787853114.820082:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21c00/0x710df789068e69ef lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853114.820088:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21c00/0x710df789068e69ef lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853114.820102:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20200/0x710df789068e69f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xa9ac69f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853114.820107:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20200/0x710df789068e69f6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xa9ac69f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853114.820113:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20200/0x710df789068e69f6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xa9ac69f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853114.820117:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4921e20200 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:3.0:1787853114.820120:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20200/0x710df789068e69f6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xa9ac69f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853114.820125:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20200/0x710df789068e69f6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xa9ac69f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853114.820132:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xa9ac69f5 (ffff8f4910f92000) 00010000:00010000:3.0:1787853114.820134:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787853114.820136:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20200/0x710df789068e69f6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xa9ac69f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853114.820141:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20200/0x710df789068e69f6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xa9ac69f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853114.820286:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4910d27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+56:10569:x1874699526135168:12345-192.168.204.1@tcp:36:lhsmtool_posix.0 Request processed in 2927us (3107us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787853114.820301:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 117 00000100:00100000:3.0:1787853114.845068:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853114.845480:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526135296 00000100:00100000:1.0:1787853114.845491:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526135296 00000100:00100000:1.0:1787853114.845555:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 118 00000100:00100000:1.0:1787853114.845565:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49056dda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+56:10569:x1874699526135296:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787853114.845626:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853114.845757:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad600/0x710df789068e69fd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c50793897df expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853114.845810:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad000/0x710df789068e6a04 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853114.845823:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad000/0x710df789068e6a04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853114.845835:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad000/0x710df789068e6a04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853114.845952:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad600/0x710df789068e69fd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793897df expref: 58 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853114.845980:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad000/0x710df789068e6a04 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793897df expref: 57 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853114.845988:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8f4914d11000) 00010000:00010000:1.0:1787853114.845991:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787853114.845995:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f492a8ad000, rc 0) 00000100:00100000:1.0:1787853114.846065:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49056dda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+57:10569:x1874699526135296:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 Request processed in 502us (1018us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853114.846073:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 118 00000100:00100000:2.0:1787853114.861896:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853114.862144:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526135552 00000100:00100000:1.0:1787853114.862155:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526135552 00000100:00100000:1.0:1787853114.862215:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 119 00000100:00100000:1.0:1787853114.862225:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f491419a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+57:10569:x1874699526135552:12345-192.168.204.1@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787853114.862321:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad600/0x710df789068e6a0b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853114.862339:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad600/0x710df789068e6a0b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853114.862351:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad600/0x710df789068e6a0b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787853114.862647:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:1.0:1787853114.862770:0:5838:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 434404199089ns, next at 435404195368ns, rc = 0 00000004:00010000:1.0:1787853114.862948:0:5838:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a619e0a8 reply state 00000000134af8cb transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad600/0x710df789068e6a0b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853114.862981:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787853114.863179:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f491419a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+59:10569:x1874699526135552:12345-192.168.204.1@tcp:36:lhsmtool_posix.0 Request processed in 953us (1291us total) trans 4294967399 rc 0/0 00000100:00100000:1.0:1787853114.863188:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 119 00000100:00100000:0.0:1787853114.873071:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00010000:00010000:2.0:1787853114.873398:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad600/0x710df789068e6a0b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853114.873421:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad600/0x710df789068e6a0b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853114.873447:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad600/0x710df789068e6a0b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853114.873454:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f492a8ad600 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:2.0:1787853114.873458:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad600/0x710df789068e6a0b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853114.873467:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad600/0x710df789068e6a0b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853114.873484:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8f4914d11000) 00010000:00010000:2.0:1787853114.873487:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787853114.873492:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad600/0x710df789068e6a0b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853114.873498:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad600/0x710df789068e6a0b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853114.875498:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526135680 00000100:00100000:3.0:1787853114.875514:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526135680 00000100:00100000:2.0:1787853114.875875:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 120 00000100:00100000:2.0:1787853114.875889:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4910d27c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+58:10569:x1874699526135680:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787853114.875991:0:8462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853114.876025:0:8462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8600/0x710df789068e6a12 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c50793897e6 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853114.876112:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8600/0x710df789068e6a12 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793897e6 expref: 59 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853114.876128:0:8462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8600/0x710df789068e6a12 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793897e6 expref: 59 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853114.876173:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8f4914d11000) 00010000:00010000:2.0:1787853114.876176:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787853114.876181:0:8462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49415b8600, rc 0) 00000100:00100000:2.0:1787853114.876262:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4910d27c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+59:10569:x1874699526135680:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 Request processed in 377us (3211us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853114.876269:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 120 00000100:00100000:2.0:1787853114.880159:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853114.880256:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526135808 00000100:00100000:3.0:1787853114.880264:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526135808 00000100:00100000:3.0:1787853114.880328:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 39 00000100:00100000:3.0:1787853114.880337:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49056d8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+6:2364:x1874699526135808:12345-192.168.204.1@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1787853114.881128:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49056d8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+7:2364:x1874699526135808:12345-192.168.204.1@tcp:2:lhsmtool_posix.0 Request processed in 788us (975us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1787853114.881137:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 39 00000100:00100000:3.0:1787853114.883826:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853114.884026:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526136064 00000100:00100000:0.0:1787853114.884037:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526136064 00000100:00100000:0.0:1787853114.884111:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 30 00000100:00100000:0.0:1787853114.884122:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49056df840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+59:10569:x1874699526136064:12345-192.168.204.1@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787853114.884460:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49056df840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+60:10569:x1874699526136064:12345-192.168.204.1@tcp:35:lhsmtool_posix.0 Request processed in 339us (643us total) trans 4294967400 rc 0/0 00000100:00100000:0.0:1787853114.884468:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 30 00000100:00100000:0.0:1787853114.887795:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853114.887943:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526136320 00000100:00100000:1.0:1787853114.887955:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526136320 00000100:00100000:1.0:1787853114.888018:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 121 00000100:00100000:1.0:1787853114.888028:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4910d24780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+60:10569:x1874699526136320:12345-192.168.204.1@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787853114.888155:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4910d24780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+60:10569:x1874699526136320:12345-192.168.204.1@tcp:57:lhsmtool_posix.0 Request processed in 128us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853114.888161:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 121 00000100:00100000:2.0:1787853114.891238:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853114.891532:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526136448 00000100:00100000:1.0:1787853114.891543:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526136448 00000100:00100000:1.0:1787853114.891642:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 122 00000100:00100000:1.0:1787853114.891663:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49056d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+60:10569:x1874699526136448:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787853114.891685:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853114.891708:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ac400/0x710df789068e6a19 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c50793897ed expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853114.891785:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ac000/0x710df789068e6a20 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853114.891799:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ac000/0x710df789068e6a20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853114.891812:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ac000/0x710df789068e6a20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787853114.891870:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787853114.891891:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ac000/0x710df789068e6a20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853114.891933:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ac400/0x710df789068e6a19 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793897ed expref: 62 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853114.891952:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ac000/0x710df789068e6a20 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793897ed expref: 61 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853114.891962:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8f4914d11000) 00010000:00010000:1.0:1787853114.891965:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787853114.891968:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f492a8ac000, rc 0) 00000100:00100000:1.0:1787853114.892026:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49056d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+61:10569:x1874699526136448:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 Request processed in 375us (800us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853114.892033:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 122 00000100:00100000:2.0:1787853114.898497:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853114.898603:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526136576 00000100:00100000:0.0:1787853114.898614:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526136576 00000100:00100000:0.0:1787853114.898673:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 40 00000100:00100000:0.0:1787853114.898684:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49056d9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+7:2363:x1874699526136576:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787853114.898703:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853114.898728:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004fdc8612/0x710df789068e6a27 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c50793897f4 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787853114.898757:0:6681:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a90793b, blocks: 0x1 00010000:00010000:0.0:1787853114.898777:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=434s v=(0 0) 00010000:00010000:0.0:1787853114.898792:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787853114.898802:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004fdc8612/0x710df789068e6a27 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793897f4 expref: 8 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853114.898821:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004fdc8612/0x710df789068e6a27 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793897f4 expref: 8 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853114.898852:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49415b7200, rc 0) 00000100:00100000:0.0:1787853114.899039:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49056d9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+8:2363:x1874699526136576:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 Request processed in 357us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853114.899046:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 40 00000100:00100000:0.0:1787853114.902495:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853114.902599:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526136832 00000100:00100000:1.0:1787853114.902610:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526136832 00000100:00100000:1.0:1787853114.902676:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 123 00000100:00100000:1.0:1787853114.902685:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4910d252c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+61:10569:x1874699526136832:12345-192.168.204.1@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787853114.903004:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4910d252c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+61:10569:x1874699526136832:12345-192.168.204.1@tcp:57:lhsmtool_posix.0 Request processed in 319us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853114.903013:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 123 00000100:00100000:2.0:1787853114.906477:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853114.906603:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526136960 00000100:00100000:1.0:1787853114.906613:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526136960 00000100:00100000:1.0:1787853114.906756:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 41 00000100:00100000:1.0:1787853114.906768:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49056d9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+8:10569:x1874699526136960:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787853114.906869:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853114.906889:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000095a932e7/0x710df789068e6a2e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c50793897fb expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853114.907000:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004fdc8612/0x710df789068e6a27 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793897f4 expref: 9 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853114.907010:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787853114.907014:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787853114.907019:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095a932e7/0x710df789068e6a2e lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793897fb expref: 9 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853114.907065:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004fdc8612/0x710df789068e6a27 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793897f4 expref: 9 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853114.907078:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004fdc8612/0x710df789068e6a27 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793897f4 expref: 9 pid: 6681 timeout: 534 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853114.907092:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f493fd543c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6682:1874699552367104:192.168.204.1@tcp:104: 00000100:00100000:1.0:1787853114.907606:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f4905074000 going to sleep for 11 seconds 00000100:00100000:3.0:1787853114.912096:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853114.913201:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526137088 00000100:00100000:1.0:1787853114.913215:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526137088 00010000:00010000:1.0:1787853114.913269:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004fdc8612/0x710df789068e6a27 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793897f4 expref: 10 pid: 6681 timeout: 534 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853114.913311:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 54 00000100:00100000:1.0:1787853114.913334:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4905684050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+10:2363:x1874699526137088:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787853114.913349:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787853114.913370:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004fdc8612/0x710df789068e6a27 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793897f4 expref: 10 pid: 6681 timeout: 534 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853114.913384:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004fdc8612/0x710df789068e6a27 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793897f4 expref: 10 pid: 6681 timeout: 534 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853114.913408:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787853114.913413:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787853114.913421:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000095a932e7/0x710df789068e6a2e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793897fb expref: 10 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853114.913431:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095a932e7/0x710df789068e6a2e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793897fb expref: 10 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853114.913469:0:5822:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000095a932e7/0x710df789068e6a2e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793897fb expref: 10 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853114.913482:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f493fd54f00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5822:1874699552367232:192.168.204.1@tcp:105: 00000100:00100000:1.0:1787853114.913598:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f4905074480 going to sleep for 11 seconds 00000100:00100000:3.0:1787853114.917085:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f493fd54f00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5822:1874699552367232:192.168.204.1@tcp:105: 00010000:00010000:3.0:1787853114.917118:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787853114.917184:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4905684050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+10:2363:x1874699526137088:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 3850us (5098us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853114.917196:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 54 00010000:00010000:0.0:1787853114.917412:0:6682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004fdc8612/0x710df789068e6a27 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793897f4 expref: 9 pid: 6681 timeout: 534 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853114.917432:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f493fd543c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6682:1874699552367104:192.168.204.1@tcp:104: 00010000:00010000:0.0:1787853114.917453:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000095a932e7/0x710df789068e6a2e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793897fb expref: 8 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853114.917467:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f492a8ac400, rc 0) 00000100:00100000:0.0:1787853114.917492:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49056d9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+8:10569:x1874699526136960:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 Request processed in 10727us (11024us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853114.917499:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 41 00000100:00100000:3.0:1787853114.921771:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853114.921886:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526137216 00000100:00100000:1.0:1787853114.921896:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526137216 00002000:00100000:1.0:1787853114.921971:0:6688:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff8f49056dc3c0 x1874699526137216/t0(0) o4->b1d98f5a-0be0-4f69-83a6-833c935c8205@192.168.204.1@tcp:290/0 lens 504/0 e 0 to 0 dl 1787853125 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787853114.921984:0:6688:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff8f49056dc3c0 with x1874699526137216 ext(0->12) 00002000:00010000:1.0:1787853114.922007:0:6688:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8f49056dc3c0 00000100:00100000:1.0:1787853114.922040:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 3 00000100:00100000:1.0:1787853114.922062:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49056dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+8:2362:x1874699526137216:12345-192.168.204.1@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1787853114.922565:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49056dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+10:2362:x1874699526137216:12345-192.168.204.1@tcp:4:lhsmtool_posix.0 Request processed in 514us (804us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1787853114.922609:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 3 00002000:00100000:1.0:1787853114.922616:0:6688:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff8f49056dc3c0 x1874699526137216/t4294967309(0) o4->b1d98f5a-0be0-4f69-83a6-833c935c8205@192.168.204.1@tcp:290/0 lens 504/448 e 0 to 0 dl 1787853125 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787853114.922624:0:6688:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff8f49056dc3c0 with x1874699526137216 ext(0->12) 00002000:00010000:1.0:1787853114.922627:0:6688:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8f49056dc3c0 00000100:00100000:1.0:1787853114.925993:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853114.926171:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526137344 00000100:00100000:2.0:1787853114.926183:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526137344 00000100:00100000:2.0:1787853114.926249:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 124 00000100:00100000:2.0:1787853114.926259:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493fd543c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+61:10569:x1874699526137344:12345-192.168.204.1@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1787853114.966514:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493fd543c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+61:10569:x1874699526137344:12345-192.168.204.1@tcp:44:lhsmtool_posix.0 Request processed in 40243us (40519us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853114.966527:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 124 00000001:00080000:1.0:1787853114.967402:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:1.0:1787853114.967426:0:5858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000100:00100000:0.0:1787853114.970328:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853114.970421:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526137472 00000100:00100000:2.0:1787853114.970429:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526137472 00000100:00100000:2.0:1787853114.970488:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 42 00000100:00100000:2.0:1787853114.970499:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4910d24f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+10:2363:x1874699526137472:12345-192.168.204.1@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1787853114.970640:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49056ded00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552367360:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787853114.970702:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853114.971025:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552367360 00000100:00100000:0.0:1787853114.971029:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552367360 00000100:00100000:0.0:1787853114.971073:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787853114.971081:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49056db0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3306:x1874699552367360:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1787853114.971096:0:6684:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:0.0:1787853114.971129:0:6684:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a907939, atime: 0x6a907939, ctime: 0x6a907939, blocks: 0x1 00010000:00010000:0.0:1787853114.971136:0:6684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c611a504/0x710df789068e6a35 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853114.971168:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=434s v=(0 0) 00010000:00010000:0.0:1787853114.971172:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787853114.971179:0:6684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c611a504/0x710df789068e6a35 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853114.971195:0:6684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c611a504/0x710df789068e6a35 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853114.971206:0:6684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c611a504/0x710df789068e6a35 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853114.971213:0:6684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c611a504/0x710df789068e6a35 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853114.971233:0:6684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000020:00080000:1.0:1787853114.972096:0:5858:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8f49065f7780 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:1.0:1787853114.972103:0:5858:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8f49093ffb00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8f49065f7480 00000020:00080000:1.0:1787853114.972105:0:5858:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8f49093ff700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8f490576e000 00000004:00080000:1.0:1787853114.972122:0:5858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000004:00080000:1.0:1787853114.972143:0:5858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:1.0:1787853114.972185:0:5858:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:1.0:1787853114.972210:0:5858:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8f490664aa80 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:1.0:1787853114.972213:0:5858:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8f493c767e00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8f492064e9c0 00000020:00080000:1.0:1787853114.972215:0:5858:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8f493c767100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8f49053f6c00 00000020:00080000:1.0:1787853114.972268:0:5870:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:1.0:1787853114.972407:0:5870:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1787853114.972644:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49056db0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3306:x1874699552367360:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1561us (1938us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1787853114.972664:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00010000:0.0:1787853114.972694:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787853114.972702:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c611a504/0x710df789068e6a35 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853114.972713:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b6800 already unused, calling callback (ffffffffc1528440) 00010000:00010000:0.0:1787853114.972717:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c611a504/0x710df789068e6a35 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853114.972742:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c611a504/0x710df789068e6a35 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853114.972761:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c611a504/0x710df789068e6a35 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853114.972769:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c611a504/0x710df789068e6a35 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853114.972803:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853114.972805:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853114.972807:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787853114.973451:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f494159c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874699552367616:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1787853114.973509:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853114.973585:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552367616 00000100:00100000:3.0:1787853114.973591:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552367616 00000100:00100000:3.0:1787853114.973638:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787853114.973647:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4910d25a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1874699552367616:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1787853114.973853:0:6682:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1787853114.973857:0:6682:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787853115 00002000:00010000:3.0:1787853114.973860:0:6682:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1787853114.973862:0:6682:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1787853115 -> 1787853115 00002000:00010000:3.0:1787853114.973864:0:6682:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1787853114.973954:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f493fd54f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874699552367488:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787853114.973984:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1787853114.974240:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8f49056ded00/2, rc 0, transno 4294967304 00000100:00100000:2.0:1787853114.974246:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49056ded00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552367360:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787853114.974264:0:8463:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:2.0:1787853114.974273:0:8463:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:1.0:1787853114.976198:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552367488 00000100:00100000:1.0:1787853114.976213:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552367488 00000100:00100000:1.0:1787853114.976327:0:12025:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787853114.976337:0:12025:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4941af21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3307:x1874699552367488:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1787853114.976369:0:12025:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:1.0:1787853114.976396:0:12025:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000090de6db0/0x710df789068e6a3c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853114.976418:0:12025:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d150288e/0x710df789068e67f7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.1@tcp remote: 0xd0a9c507938975a expref: 10 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853114.976426:0:12025:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1787853114.976430:0:12025:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787853114.976435:0:12025:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000090de6db0/0x710df789068e6a3c lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853114.976470:0:12025:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d150288e/0x710df789068e67f7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.1@tcp remote: 0xd0a9c507938975a expref: 10 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853114.976486:0:12025:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d150288e/0x710df789068e67f7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.1@tcp remote: 0xd0a9c507938975a expref: 10 pid: 6682 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853114.976500:0:12025:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4941af3c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12025:1874699552367744:192.168.204.1@tcp:104: 00000100:00100000:1.0:1787853114.976726:0:12025:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f4905074d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787853114.979752:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4910d25a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3308:x1874699552367616:12345-0@lo:2:osp-syn-0-0.0 Request processed in 6091us (6228us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1787853114.979771:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:3.0:1787853114.979834:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787853114.980097:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853114.980318:0:12025:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4941af3c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12025:1874699552367744:192.168.204.1@tcp:104: 00010000:00010000:3.0:1787853114.980345:0:12025:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000090de6db0/0x710df789068e6a3c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853114.981138:0:3308:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:1.0:1787853114.981146:0:3308:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967305 00000100:00100000:1.0:1787853114.981171:0:3308:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8f494159c000 x1874699552367616/t4294967310(4294967310) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1787853130 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1787853114.981182:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8f494159c000/2, rc 0, transno 4294967310 00000100:00100000:1.0:1787853114.981188:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f494159c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874699552367616:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1787853114.984519:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526137600 00000100:00100000:0.0:1787853114.984534:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526137600 00010000:00010000:0.0:1787853114.984616:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d150288e/0x710df789068e67f7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.1@tcp remote: 0xd0a9c507938975a expref: 11 pid: 6682 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853114.984671:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 55 00000100:00100000:0.0:1787853114.984683:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4941af1680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+11:2362:x1874699526137600:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787853114.984700:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787853114.984706:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d150288e/0x710df789068e67f7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.1@tcp remote: 0xd0a9c507938975a expref: 11 pid: 6682 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853114.984743:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d150288e/0x710df789068e67f7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.1@tcp remote: 0xd0a9c507938975a expref: 11 pid: 6682 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853114.984772:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d150288e/0x710df789068e67f7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.1@tcp remote: 0xd0a9c507938975a expref: 11 pid: 6682 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853114.984801:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787853114.984806:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787853114.984812:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000090de6db0/0x710df789068e6a3c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853114.984823:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000090de6db0/0x710df789068e6a3c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853114.984853:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787853114.984929:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4941af1680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+10:2362:x1874699526137600:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 248us (4834us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853114.984937:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 55 00010000:00010000:0.0:1787853114.985093:0:12025:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000090de6db0/0x710df789068e6a3c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853114.985104:0:12025:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000090de6db0/0x710df789068e6a3c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853114.985113:0:12025:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000090de6db0/0x710df789068e6a3c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853114.985129:0:12025:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000090de6db0/0x710df789068e6a3c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853114.985145:0:12025:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787853114.985159:0:8449:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787853114.985165:0:8449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000090de6db0/0x710df789068e6a3c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853114.985172:0:8449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f492a8ad200 already unused, calling callback (ffffffffc1528440) 00010000:00010000:0.0:1787853114.985178:0:8449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000090de6db0/0x710df789068e6a3c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853114.985186:0:8449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000090de6db0/0x710df789068e6a3c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853114.985199:0:8449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000090de6db0/0x710df789068e6a3c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853114.985206:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000090de6db0/0x710df789068e6a3c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853114.985222:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853114.985224:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853114.985226:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787853114.985817:0:12025:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4941af21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3307:x1874699552367488:12345-0@lo:6:osp-syn-0-0.0 Request processed in 9479us (11828us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1787853114.985832:0:12025:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000004:00080000:1.0:1787853114.988370:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8f493fd54f00/2, rc 0, transno 4294967311 00000100:00100000:1.0:1787853114.988386:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f493fd54f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874699552367488:0@lo:6:osp-syn-0-0.0 00000001:00080000:1.0:1787853115.018222:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000100:00100000:2.0:1787853115.018489:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4910d24f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+6:2363:x1874699526137472:12345-192.168.204.1@tcp:16:lhsmtool_posix.0 Request processed in 47986us (48161us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853115.018503:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 42 00000100:00100000:1.0:1787853115.023263:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853115.023448:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526137856 00000100:00100000:3.0:1787853115.023458:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526137856 00000100:00100000:3.0:1787853115.023595:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 125 00000100:00100000:3.0:1787853115.023608:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4941af2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+15:10569:x1874699526137856:12345-192.168.204.1@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787853115.023678:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787853115.023707:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ac000/0x710df789068e6a20 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793897ed expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853115.023727:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8f4914d11000) 00010000:00010000:3.0:1787853115.023733:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787853115.023768:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20200/0x710df789068e6a43 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853115.023848:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20200/0x710df789068e6a43 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853115.023884:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20200/0x710df789068e6a43 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787853115.024280:0:5836:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006f8e0d89 reply state 00000000c9af044b transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20200/0x710df789068e6a43 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853115.024290:0:5836:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787853115.024560:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4941af2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+16:10569:x1874699526137856:12345-192.168.204.1@tcp:36:lhsmtool_posix.0 Request processed in 953us (1305us total) trans 4294967401 rc 0/0 00000100:00100000:3.0:1787853115.024602:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 125 00000100:00080000:0.0:1787853115.024801:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787853115.029287:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853115.029609:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526137984 00000100:00100000:2.0:1787853115.029620:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526137984 00000100:00100000:2.0:1787853115.029707:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 46 00000100:00100000:2.0:1787853115.029718:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4941af1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+6:2362:x1874699526137984:12345-192.168.204.1@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787853115.030157:0:8463:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1787853115.030162:0:8463:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1787853115 -> 1787853114 00002000:00010000:2.0:1787853115.030165:0:8463:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787853113 00002000:00010000:2.0:1787853115.030167:0:8463:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1787853115 -> 1787853114 00002000:00010000:2.0:1787853115.030170:0:8463:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1787853115.030236:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4941af1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+7:2362:x1874699526137984:12345-192.168.204.1@tcp:2:lhsmtool_posix.0 Request processed in 520us (961us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1787853115.030245:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 46 00010000:00010000:0.0:1787853115.030461:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20200/0x710df789068e6a43 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853115.030472:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20200/0x710df789068e6a43 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853115.030480:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20200/0x710df789068e6a43 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853115.030487:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4921e20200 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:0.0:1787853115.030493:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20200/0x710df789068e6a43 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853115.030503:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20200/0x710df789068e6a43 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853115.030519:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8f4914d11000) 00010000:00010000:0.0:1787853115.030523:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787853115.030527:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20200/0x710df789068e6a43 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853115.030533:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20200/0x710df789068e6a43 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787853115.030631:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787853115.038222:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853115.038320:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526138240 00000100:00100000:0.0:1787853115.038396:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526138240 00000100:00100000:0.0:1787853115.038496:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 126 00000100:00100000:0.0:1787853115.038507:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49056d8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+15:10569:x1874699526138240:12345-192.168.204.1@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1787853115.038621:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6800/0x710df789068e6a4a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853115.038640:0:8462:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad000/0x710df789068e6a04 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793897df expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853115.038649:0:8462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6800/0x710df789068e6a4a lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853115.038757:0:8462:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad000/0x710df789068e6a04 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793897df expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853115.038771:0:8462:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad000/0x710df789068e6a04 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793897df expref: 15 pid: 5837 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853115.038797:0:8462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4910d24000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8462:1874699552367872:192.168.204.1@tcp:104: 00000100:00100000:0.0:1787853115.038946:0:8462:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f49065f7e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787853115.043519:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853115.043604:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526138368 00000100:00100000:2.0:1787853115.043615:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526138368 00010000:00010000:2.0:1787853115.043666:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad000/0x710df789068e6a04 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793897df expref: 16 pid: 5837 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853115.043711:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 56 00000100:00100000:2.0:1787853115.043721:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4941af3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+16:2362:x1874699526138368:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787853115.043738:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787853115.043744:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad000/0x710df789068e6a04 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793897df expref: 16 pid: 5837 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853115.043790:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad000/0x710df789068e6a04 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793897df expref: 16 pid: 5837 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853115.043816:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8f4914d11000) 00010000:00010000:2.0:1787853115.043823:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6800/0x710df789068e6a4a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853115.043833:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6800/0x710df789068e6a4a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853115.043840:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6800/0x710df789068e6a4a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853115.043859:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787853115.044137:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4941af3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+16:2362:x1874699526138368:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 416us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853115.044145:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 56 00010000:00010000:0.0:1787853115.047483:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad000/0x710df789068e6a04 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793897df expref: 15 pid: 5837 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853115.047512:0:8462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4910d24000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8462:1874699552367872:192.168.204.1@tcp:104: 00010000:00010000:0.0:1787853115.047541:0:8462:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6800/0x710df789068e6a4a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853115.047552:0:8462:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6800/0x710df789068e6a4a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853115.047557:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6800/0x710df789068e6a4a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853115.047871:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6800/0x710df789068e6a4a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853115.047878:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6800/0x710df789068e6a4a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853115.047885:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6800/0x710df789068e6a4a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853115.047891:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b6800 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:0.0:1787853115.047896:0:8462:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6800/0x710df789068e6a4a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853115.047973:0:8462:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6800/0x710df789068e6a4a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853115.047993:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8f4914d11000) 00010000:00010000:0.0:1787853115.047996:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787853115.048002:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6800/0x710df789068e6a4a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853115.048009:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6800/0x710df789068e6a4a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853115.048170:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49056d8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+14:10569:x1874699526138240:12345-192.168.204.1@tcp:55:lhsmtool_posix.0 Request processed in 9663us (9955us total) trans 0 rc -22/-22 00000100:00100000:0.0:1787853115.048181:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 126 00000100:00100000:1.0:1787853115.054764:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853115.055018:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526138496 00000100:00100000:2.0:1787853115.055029:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526138496 00000100:00100000:2.0:1787853115.055122:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 47 00000100:00100000:2.0:1787853115.055133:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f494159de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+7:2362:x1874699526138496:12345-192.168.204.1@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787853115.055183:0:6684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000171d645e/0x710df789068e6a51 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853115.055204:0:6684:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000095a932e7/0x710df789068e6a2e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793897fb expref: 7 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853115.055235:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787853115.055240:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787853115.055245:0:6684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000171d645e/0x710df789068e6a51 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853115.055278:0:6684:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000095a932e7/0x710df789068e6a2e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793897fb expref: 7 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853115.055293:0:6684:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000095a932e7/0x710df789068e6a2e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793897fb expref: 7 pid: 6682 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853115.055308:0:6684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49056da940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6684:1874699552368000:192.168.204.1@tcp:104: 00000100:00100000:2.0:1787853115.055389:0:6684:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f4904c00600 going to sleep for 11 seconds 00000100:00100000:1.0:1787853115.060031:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853115.060187:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526138624 00000100:00100000:3.0:1787853115.060197:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526138624 00010000:00010000:3.0:1787853115.060241:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000095a932e7/0x710df789068e6a2e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793897fb expref: 8 pid: 6682 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853115.060292:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 57 00000100:00100000:3.0:1787853115.060303:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4910d10780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+8:2362:x1874699526138624:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787853115.060320:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787853115.060355:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000095a932e7/0x710df789068e6a2e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793897fb expref: 8 pid: 6682 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853115.060370:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000095a932e7/0x710df789068e6a2e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793897fb expref: 8 pid: 6682 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853115.060398:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787853115.060403:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787853115.060429:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000171d645e/0x710df789068e6a51 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853115.060439:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000171d645e/0x710df789068e6a51 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853115.060460:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787853115.060517:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4910d10780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+8:2362:x1874699526138624:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 216us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853115.060525:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 57 00010000:00010000:2.0:1787853115.061539:0:6684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000095a932e7/0x710df789068e6a2e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793897fb expref: 7 pid: 6682 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853115.061560:0:6684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49056da940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6684:1874699552368000:192.168.204.1@tcp:104: 00010000:00010000:2.0:1787853115.061625:0:6684:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000171d645e/0x710df789068e6a51 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853115.061636:0:6684:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000171d645e/0x710df789068e6a51 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853115.061643:0:6684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000171d645e/0x710df789068e6a51 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853115.061696:0:6684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000171d645e/0x710df789068e6a51 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853115.061704:0:6684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000171d645e/0x710df789068e6a51 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853115.061713:0:6684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000171d645e/0x710df789068e6a51 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853115.061720:0:6684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b9600 already unused, calling callback (ffffffffc1528440) 00010000:00010000:2.0:1787853115.061724:0:6684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000171d645e/0x710df789068e6a51 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853115.061733:0:6684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000171d645e/0x710df789068e6a51 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853115.061753:0:6684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000171d645e/0x710df789068e6a51 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853115.061761:0:6684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000171d645e/0x710df789068e6a51 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853115.061840:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f494159de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+6:2362:x1874699526138496:12345-192.168.204.1@tcp:1:lhsmtool_posix.0 Request processed in 6708us (7084us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853115.061848:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 47 00000100:00100000:1.0:1787853115.069617:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853115.069711:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526138880 00000100:00100000:3.0:1787853115.069722:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526138880 00000100:00100000:3.0:1787853115.069786:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 127 00000100:00100000:3.0:1787853115.069796:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4910d121c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+14:10569:x1874699526138880:12345-192.168.204.1@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787853115.069876:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21c00/0x710df789068e6a58 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853115.069893:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21c00/0x710df789068e6a58 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853115.069917:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21c00/0x710df789068e6a58 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853115.070136:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21800/0x710df789068e6a5f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853115.070148:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8600/0x710df789068e6a12 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793897e6 expref: 15 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853115.070157:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21800/0x710df789068e6a5f lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853115.070207:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8600/0x710df789068e6a12 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793897e6 expref: 15 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853115.070221:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8600/0x710df789068e6a12 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793897e6 expref: 15 pid: 8462 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853115.070237:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49056dfc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5836:1874699552368128:192.168.204.1@tcp:104: 00000100:00100000:3.0:1787853115.070319:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f494160a540 going to sleep for 11 seconds 00000100:00100000:2.0:1787853115.074006:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853115.074093:0:11175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526139008 00000100:00100000:1.0:1787853115.074102:0:11175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526139008 00010000:00010000:1.0:1787853115.074147:0:11175:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8600/0x710df789068e6a12 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793897e6 expref: 16 pid: 8462 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853115.074193:0:11175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 58 00000100:00100000:1.0:1787853115.074203:0:11175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49056da940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b1d98f5a-0be0-4f69-83a6-833c935c8205+16:2362:x1874699526139008:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787853115.074218:0:11175:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787853115.074225:0:11175:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8600/0x710df789068e6a12 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793897e6 expref: 16 pid: 8462 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853115.074261:0:11175:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8600/0x710df789068e6a12 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793897e6 expref: 16 pid: 8462 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853115.074285:0:11175:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8f4914d11000) 00010000:00010000:1.0:1787853115.074290:0:11175:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21800/0x710df789068e6a5f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853115.074299:0:11175:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21800/0x710df789068e6a5f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853115.074307:0:11175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21800/0x710df789068e6a5f lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853115.074325:0:11175:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787853115.074384:0:11175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49056da940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b1d98f5a-0be0-4f69-83a6-833c935c8205+16:2362:x1874699526139008:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 182us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853115.074391:0:11175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 58 00010000:00010000:3.0:1787853115.075345:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8600/0x710df789068e6a12 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793897e6 expref: 15 pid: 8462 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853115.075368:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49056dfc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5836:1874699552368128:192.168.204.1@tcp:104: 00010000:00010000:3.0:1787853115.075390:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21800/0x710df789068e6a5f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853115.075400:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21800/0x710df789068e6a5f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853115.075406:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21800/0x710df789068e6a5f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787853115.075635:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:3.0:1787853115.076268:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:3.0:1787853115.076315:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:3.0:1787853115.076403:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49056dfc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5836:1874699552368256:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1787853115.076465:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853115.076503:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f49419c4780 going to sleep for 11 seconds 00000100:00100000:1.0:1787853115.077463:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552368256 00000100:00100000:1.0:1787853115.077474:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552368256 00000100:00100000:1.0:1787853115.077536:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787853115.077547:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49056dc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5836:x1874699552368256:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787853115.077693:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49056dc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5836:x1874699552368256:12345-0@lo:1000:mdt00_000.0 Request processed in 147us (1226us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853115.077701:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787853115.078348:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49056dfc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5836:1874699552368256:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1787853115.079482:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:0.0:1787853115.079610:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4910d24000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5836:1874699552368384:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787853115.079680:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853115.079724:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f49065f7180 going to sleep for 11 seconds 00000100:00100000:1.0:1787853115.079925:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552368384 00000100:00100000:1.0:1787853115.079932:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552368384 00000100:00100000:1.0:1787853115.079993:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787853115.080002:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4910d24b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5836:x1874699552368384:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787853115.080225:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4910d24b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:5836:x1874699552368384:12345-0@lo:1000:mdt00_000.0 Request processed in 224us (544us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1787853115.080234:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787853115.080522:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4910d24000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5836:1874699552368384:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1787853115.080562:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21800/0x710df789068e6a5f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853115.080601:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21800/0x710df789068e6a5f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853115.080608:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21800/0x710df789068e6a5f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853115.080615:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4921e21800 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:0.0:1787853115.080620:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21800/0x710df789068e6a5f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853115.080627:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21800/0x710df789068e6a5f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853115.080646:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8f4914d11000) 00010000:00010000:0.0:1787853115.080659:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787853115.080665:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21800/0x710df789068e6a5f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853115.080671:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21800/0x710df789068e6a5f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853115.080703:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ada00/0x710df789068e69a2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853115.080709:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ada00/0x710df789068e69a2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853115.080715:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ada00/0x710df789068e69a2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853115.080731:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f492a8ada00 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:0.0:1787853115.080735:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ada00/0x710df789068e69a2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853115.080741:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ada00/0x710df789068e69a2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853115.080749:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8f491176b200) 00010000:00010000:0.0:1787853115.080751:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787853115.080759:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20e00/0x710df789068e69a9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793897ca expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853115.080770:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20e00/0x710df789068e69a9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793897ca expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853115.081169:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20e00/0x710df789068e69a9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793897ca expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853115.081209:0:5836:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20e00/0x710df789068e69a9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793897ca expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853115.081224:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4910d261c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5836:1874699552368512:192.168.204.1@tcp:105: 00000100:00100000:0.0:1787853115.081356:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f49065f7180 going to sleep for 11 seconds 00000100:00100000:2.0:1787853115.089450:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853115.089799:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526139136 00000100:00100000:1.0:1787853115.089809:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526139136 00000100:00100000:1.0:1787853115.089881:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 31 00000100:00100000:1.0:1787853115.089893:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49056d92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+19:10568:x1874699526139136:12345-192.168.204.1@tcp:49:lfs.0 00000100:00100000:1.0:1787853115.090074:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49056d92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+19:10568:x1874699526139136:12345-192.168.204.1@tcp:49:lfs.0 Request processed in 183us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853115.090082:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 31 00000100:00100000:0.0:1787853115.090283:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4910d261c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5836:1874699552368512:192.168.204.1@tcp:105: 00010000:00010000:0.0:1787853115.090311:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ada00/0x710df789068e69a2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853115.090340:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ada00/0x710df789068e69a2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853115.090372:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e6a66 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853115.090386:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e6a66 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853115.090411:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e6a66 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853115.090422:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e6a66 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853115.090428:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e6a66 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853115.090435:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e6a66 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853115.090441:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b7c00 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:0.0:1787853115.090445:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e6a66 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853115.090452:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e6a66 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853115.090464:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8f491176b200) 00010000:00010000:0.0:1787853115.090468:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787853115.090471:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e6a66 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853115.090484:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e6a66 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853115.090495:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21c00/0x710df789068e6a58 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853115.090501:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21c00/0x710df789068e6a58 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853115.090507:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21c00/0x710df789068e6a58 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853115.090512:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4921e21c00 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:0.0:1787853115.090515:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21c00/0x710df789068e6a58 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853115.090521:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21c00/0x710df789068e6a58 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853115.090529:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8f491176b200) 00010000:00010000:0.0:1787853115.090532:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787853115.090535:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21c00/0x710df789068e6a58 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853115.090541:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21c00/0x710df789068e6a58 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853115.091076:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4910d121c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+18:10569:x1874699526138880:12345-192.168.204.1@tcp:57:lhsmtool_posix.0 Request processed in 21279us (21470us total) trans 4294967406 rc 0/0 00000040:00080000:3.0:1787853115.091260:0:11690:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787853115.091265:0:11690:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:0.0:1787853115.091357:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 127 00000020:00080000:0.0:1787853115.091367:0:5836:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1787853115.091815:0:11690:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1787853115.091823:0:11690:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787853115.096144:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853115.096888:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526139392 00000100:00100000:3.0:1787853115.096901:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526139392 00000100:00100000:3.0:1787853115.096985:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 128 00000100:00100000:3.0:1787853115.096997:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49056db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+18:10568:x1874699526139392:12345-192.168.204.1@tcp:58:lfs.0 00000040:00080000:3.0:1787853115.097404:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:3.0:1787853115.097507:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49056db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+18:10568:x1874699526139392:12345-192.168.204.1@tcp:58:lfs.0 Request processed in 512us (1377us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853115.097516:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 128 00000100:00100000:1.0:1787853115.118808:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853115.122431:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526139648 00000100:00100000:2.0:1787853115.122448:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526139648 00000100:00100000:0.0:1787853115.122669:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 32 00000100:00100000:0.0:1787853115.122682:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f491040ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+18:10569:x1874699526139648:12345-192.168.204.1@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1787853115.124417:0:5840:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1787853115.124526:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:0.0:1787853115.124608:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6600/0x710df789068e6a6d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853115.124626:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6600/0x710df789068e6a6d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853115.124638:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6600/0x710df789068e6a6d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853115.124647:0:5840:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6600/0x710df789068e6a6d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853115.125149:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6600/0x710df789068e6a6d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853115.125156:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6600/0x710df789068e6a6d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853115.125217:0:5840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787853115.125340:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f491040ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+20:10569:x1874699526139648:12345-192.168.204.1@tcp:35:lhsmtool_posix.0 Request processed in 2656us (6538us total) trans 4294967408 rc 0/0 00000100:00100000:0.0:1787853115.125350:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 32 00000020:00080000:0.0:1787853115.125357:0:5840:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787853115.133592:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787853115.133608:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6600/0x710df789068e6a6d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853115.133619:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b6600 already unused, calling callback (ffffffffc1528440) 00010000:00010000:2.0:1787853115.133623:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6600/0x710df789068e6a6d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853115.133635:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6600/0x710df789068e6a6d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853115.133850:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8f491176bb00) 00010000:00010000:2.0:1787853115.133854:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787853115.133860:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6600/0x710df789068e6a6d lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853115.133866:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6600/0x710df789068e6a6d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853115.134233:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853115.134237:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853115.134239:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787853115.160110:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853115.160259:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526139776 00000100:00100000:1.0:1787853115.160270:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526139776 00000100:00100000:1.0:1787853115.160334:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 129 00000100:00100000:1.0:1787853115.160342:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4910d261c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+20:10571:x1874699526139776:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:1.0:1787853115.160368:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853115.160389:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e6a74 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c5079389802 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853115.160457:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ada00/0x710df789068e6a7b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853115.160473:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ada00/0x710df789068e6a7b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853115.160485:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ada00/0x710df789068e6a7b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853115.160520:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad800/0x710df789068e6a82 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853115.160529:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad800/0x710df789068e6a82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853115.160536:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad800/0x710df789068e6a82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853115.160901:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ac400/0x710df789068e6a89 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853115.160927:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6400/0x710df789068e6994 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793897c3 expref: 21 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853115.160934:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ac400/0x710df789068e6a89 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853115.160978:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6400/0x710df789068e6994 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793897c3 expref: 21 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853115.160991:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6400/0x710df789068e6994 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793897c3 expref: 21 pid: 5838 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853115.161004:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4910d112c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5838:1874699552368640:192.168.204.1@tcp:104: 00000100:00100000:1.0:1787853115.161099:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f4905074780 going to sleep for 11 seconds 00000100:00100000:3.0:1787853115.164663:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853115.165352:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526140032 00000100:00100000:2.0:1787853115.165363:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526140032 00000100:00100000:2.0:1787853115.165426:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 33 00000100:00100000:2.0:1787853115.165436:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49056dfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+22:5606:x1874699526140032:12345-192.168.204.1@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787853115.166212:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49056dfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+23:5606:x1874699526140032:12345-192.168.204.1@tcp:35:ldlm_bl.0 Request processed in 773us (1558us total) trans 4294967409 rc 0/0 00000100:00100000:3.0:1787853115.166222:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 33 00000100:00100000:1.0:1787853115.166323:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4910d112c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5838:1874699552368640:192.168.204.1@tcp:104: 00010000:00010000:1.0:1787853115.166350:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ac400/0x710df789068e6a89 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853115.170176:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853115.170268:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526140160 00000100:00100000:1.0:1787853115.170277:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526140160 00010000:00010000:1.0:1787853115.170318:0:8450:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6400/0x710df789068e6994 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793897c3 expref: 23 pid: 5838 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853115.170360:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 59 00000100:00100000:1.0:1787853115.170370:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49056de580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+23:2362:x1874699526140160:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787853115.170386:0:8450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787853115.170392:0:8450:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6400/0x710df789068e6994 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793897c3 expref: 23 pid: 5838 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853115.170405:0:8450:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6400/0x710df789068e6994 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793897c3 expref: 23 pid: 5838 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853115.170433:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6400/0x710df789068e6994 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793897c3 expref: 23 pid: 5838 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853115.170453:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8f491176b200) 00010000:00010000:1.0:1787853115.170460:0:8450:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ac400/0x710df789068e6a89 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853115.170470:0:8450:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ac400/0x710df789068e6a89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853115.170478:0:8450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ac400/0x710df789068e6a89 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853115.170516:0:8450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787853115.170646:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49056de580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+22:2362:x1874699526140160:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 277us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853115.170665:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 59 00010000:00010000:0.0:1787853115.170796:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ac400/0x710df789068e6a89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853115.170805:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ac400/0x710df789068e6a89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787853115.170851:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1787853115.170855:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787853115.170876:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ac400/0x710df789068e6a89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853115.170889:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ac400/0x710df789068e6a89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853115.170899:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ada00/0x710df789068e6a7b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853115.170916:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ada00/0x710df789068e6a7b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853115.170922:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ada00/0x710df789068e6a7b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853115.170928:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f492a8ada00 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:0.0:1787853115.170932:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ada00/0x710df789068e6a7b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853115.170939:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ada00/0x710df789068e6a7b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853115.170948:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8f491176b400) 00010000:00010000:0.0:1787853115.170951:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787853115.170964:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ada00/0x710df789068e6a7b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853115.170970:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ada00/0x710df789068e6a7b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853115.170982:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad800/0x710df789068e6a82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853115.170988:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad800/0x710df789068e6a82 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853115.170994:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad800/0x710df789068e6a82 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853115.170999:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f492a8ad800 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:0.0:1787853115.171002:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad800/0x710df789068e6a82 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853115.171007:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad800/0x710df789068e6a82 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853115.171015:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8f4914d11300) 00010000:00010000:0.0:1787853115.171018:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787853115.171021:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad800/0x710df789068e6a82 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853115.171026:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad800/0x710df789068e6a82 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853115.171078:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e6a74 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389802 expref: 22 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853115.171104:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ac400/0x710df789068e6a89 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389802 expref: 21 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853115.171111:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8f491176b200) 00010000:00010000:0.0:1787853115.171113:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787853115.171115:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f492a8ac400, rc 0) 00000100:00100000:0.0:1787853115.171146:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4910d261c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+21:10571:x1874699526139776:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 10804us (11047us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853115.171153:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 129 00010000:00010000:1.0:1787853115.178188:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787853116.144235:0:11690:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787853116.144249:0:11690:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787853116.144302:0:11690:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1787853116.144309:0:11690:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787853116.144452:0:11690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49056de940 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11690:1874699552368768:192.168.204.1@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787853116.144566:0:11690:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f493480d540 going to sleep for 11 seconds 00000100:00100000:3.0:1787853116.155062:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853116.155105:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526140288 00000100:00100000:3.0:1787853116.155113:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526140288 00000100:00100000:3.0:1787853116.155177:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 130 00000100:00100000:3.0:1787853116.155186:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49056df840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+22:10582:x1874699526140288:12345-192.168.204.1@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787853116.155221:0:8462:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787853116.155331:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49056df840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+22:10582:x1874699526140288:12345-192.168.204.1@tcp:53:lhsmtool_posix.0 Request processed in 145us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853116.155339:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 130 00000100:00100000:3.0:1787853116.155442:0:11690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49056de940 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11690:1874699552368768:192.168.204.1@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787853116.157098:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49056dbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5d48a955-7010-4118-9c7d-f396984ae1ff:3309:1874699552368896:0@lo:400:kworker.0 00000100:00100000:1.0:1787853116.157167:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853116.160366:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49056da580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874699552369024:0@lo:400:kworker.0 00000100:00100000:3.0:1787853116.160465:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853116.160522:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787853116.160530:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49056dad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552369152:0@lo:400:kworker.0 00000100:00100000:3.0:1787853116.160561:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853116.160610:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49056d92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1874699552369280:0@lo:400:kworker.0 00000100:00100000:3.0:1787853116.160647:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853116.160685:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552369024 00000100:00100000:3.0:1787853116.160693:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552369024 00000100:00100000:3.0:1787853116.160740:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552369280 00000100:00100000:3.0:1787853116.160744:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552369280 00000100:00100000:3.0:1787853116.160789:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1787853116.160797:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49056de940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874699552369024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853116.160852:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49056de940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874699552369024:12345-0@lo:400:kworker.0 Request processed in 56us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853116.160859:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1787853116.160876:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787853116.161173:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4934237480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874699552369280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853116.161224:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4934237480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874699552369280:12345-0@lo:400:kworker.0 Request processed in 55us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853116.161230:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787853116.161252:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552369152 00000100:00100000:3.0:1787853116.161256:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552369152 00000100:00100000:3.0:1787853116.161283:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787853116.161288:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4904cd6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3306:x1874699552369152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853116.161314:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4904cd6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3306:x1874699552369152:12345-0@lo:400:kworker.0 Request processed in 26us (753us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853116.161319:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:3.0:1787853116.161338:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787853116.161342:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787853116.161374:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49056d92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1874699552369280:0@lo:400:kworker.0 00000100:00100000:3.0:1787853116.161397:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49056dad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552369152:0@lo:400:kworker.0 00000100:00100000:3.0:1787853116.161405:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49056da580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874699552369024:0@lo:400:kworker.0 00000100:00100000:3.0:1787853116.166146:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853116.166184:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526140544 00000100:00100000:3.0:1787853116.166193:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526140544 00000100:00100000:3.0:1787853116.166254:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 131 00000100:00100000:3.0:1787853116.166264:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4934235680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+21:10582:x1874699526140544:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787853116.166289:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853116.166313:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20400/0x710df789068e6a90 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c5079389809 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853116.166421:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21a00/0x710df789068e6a97 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853116.166446:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21a00/0x710df789068e6a97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853116.167184:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21a00/0x710df789068e6a97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787853116.167201:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1787853116.167347:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20400/0x710df789068e6a90 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389809 expref: 24 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853116.167367:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21a00/0x710df789068e6a97 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389809 expref: 23 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853116.167375:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8f491176b200) 00010000:00010000:3.0:1787853116.167378:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787853116.167381:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4921e21a00, rc 0) 00000100:00100000:3.0:1787853116.167443:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4934235680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+23:10582:x1874699526140544:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 Request processed in 1181us (1308us total) trans 4294967410 rc 0/0 00000100:00100000:3.0:1787853116.167458:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 131 00000100:00100000:1.0:1787853116.169601:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552368896 00000100:00100000:1.0:1787853116.169617:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552368896 00000100:00100000:1.0:1787853116.169688:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1787853116.169697:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4906233c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+19:3309:x1874699552368896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853116.169788:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4906233c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+19:3309:x1874699552368896:12345-0@lo:400:kworker.0 Request processed in 92us (12621us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853116.169796:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1787853116.169855:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49056dbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5d48a955-7010-4118-9c7d-f396984ae1ff:3309:1874699552368896:0@lo:400:kworker.0 00000100:00100000:2.0:1787853116.173722:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787853116.173748:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49056da580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874699552369536:0@lo:400:kworker.0 00000100:00100000:2.0:1787853116.173837:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853116.174078:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787853116.174089:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49056dbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1874699552369408:0@lo:400:kworker.0 00000100:00100000:2.0:1787853116.174123:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853116.174160:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552369536 00000100:00100000:2.0:1787853116.174168:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552369536 00000100:00100000:2.0:1787853116.174227:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787853116.174237:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49056dad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3307:x1874699552369536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853116.174294:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49056dad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3307:x1874699552369536:12345-0@lo:400:kworker.0 Request processed in 58us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853116.174301:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787853116.174322:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552369408 00000100:00100000:2.0:1787853116.174325:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552369408 00000100:00100000:2.0:1787853116.174353:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787853116.174359:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49056d92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874699552369408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853116.174394:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49056d92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874699552369408:12345-0@lo:400:kworker.0 Request processed in 35us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853116.174400:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00080000:2.0:1787853116.174414:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787853116.174418:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787853116.174447:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49056da580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874699552369536:0@lo:400:kworker.0 00000100:00100000:1.0:1787853116.174857:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853116.175155:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526140672 00000100:00100000:1.0:1787853116.175161:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526140672 00000100:00100000:1.0:1787853116.175200:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 8 00000100:00100000:1.0:1787853116.175207:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4910d10b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+23:2362:x1874699526140672:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787853116.175218:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787853116.175240:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21a00/0x710df789068e6a97 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389809 expref: 23 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853116.175256:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8f491176b200) 00010000:00010000:1.0:1787853116.175260:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787853116.175299:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4910d10b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+22:2362:x1874699526140672:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 92us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853116.175319:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 8 00000100:00100000:2.0:1787853116.177094:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49056dbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1874699552369408:0@lo:400:kworker.0 00000100:00100000:2.0:1787853116.182892:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853116.183391:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526140928 00000100:00100000:2.0:1787853116.183401:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526140928 00000100:00100000:2.0:1787853116.183452:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 132 00000100:00100000:2.0:1787853116.183461:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49056dbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+22:10582:x1874699526140928:12345-192.168.204.1@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787853116.183546:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9e00/0x710df789068e6aa5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853116.183599:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9e00/0x710df789068e6aa5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853116.183614:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9e00/0x710df789068e6aa5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853116.183799:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9e00/0x710df789068e6aa5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853116.183806:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9e00/0x710df789068e6aa5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853116.183812:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9e00/0x710df789068e6aa5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853116.183818:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b9e00 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:2.0:1787853116.183822:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9e00/0x710df789068e6aa5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853116.183829:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9e00/0x710df789068e6aa5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853116.183839:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8f491176b200) 00010000:00010000:2.0:1787853116.183842:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787853116.183847:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9e00/0x710df789068e6aa5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853116.183853:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9e00/0x710df789068e6aa5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853116.183985:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49056dbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+23:10582:x1874699526140928:12345-192.168.204.1@tcp:57:lhsmtool_posix.0 Request processed in 524us (1116us total) trans 4294967411 rc 0/0 00000100:00100000:2.0:1787853116.183999:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 132 00000040:00080000:2.0:1787853116.184116:0:11690:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787853116.184121:0:11690:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787853116.184635:0:11690:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1787853116.184646:0:11690:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1787853116.192271:0:12063:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787853116.192282:0:12063:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787853116.192326:0:12063:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1787853116.192332:0:12063:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787853116.193383:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853116.193424:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526141184 00000100:00100000:0.0:1787853116.193433:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526141184 00000100:00100000:0.0:1787853116.193487:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 34 00000100:00100000:0.0:1787853116.193498:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4910d243c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+23:10582:x1874699526141184:12345-192.168.204.1@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787853116.193773:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4910d243c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+24:10582:x1874699526141184:12345-192.168.204.1@tcp:35:lhsmtool_posix.0 Request processed in 276us (396us total) trans 4294967412 rc 0/0 00000100:00100000:0.0:1787853116.193782:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 34 00010000:00010000:0.0:1787853116.203816:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787853116.543410:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853116.543614:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526141440 00000100:00100000:3.0:1787853116.543625:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526141440 00000100:00100000:3.0:1787853116.543688:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 133 00000100:00100000:3.0:1787853116.543700:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49056da580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+24:10595:x1874699526141440:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:3.0:1787853116.543737:0:8462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853116.543758:0:8462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20400/0x710df789068e6aac lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c5079389810 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853116.543863:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21200/0x710df789068e6ab3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853116.543878:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21200/0x710df789068e6ab3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853116.543893:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21200/0x710df789068e6ab3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787853116.543904:0:8462:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1787853116.544051:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20400/0x710df789068e6aac lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389810 expref: 27 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853116.544067:0:8462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21200/0x710df789068e6ab3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389810 expref: 26 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853116.544076:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8f491176b200) 00010000:00010000:3.0:1787853116.544079:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787853116.544083:0:8462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4921e21200, rc 0) 00000100:00100000:3.0:1787853116.544148:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49056da580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+26:10595:x1874699526141440:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 450us (749us total) trans 4294967413 rc 0/0 00000100:00100000:3.0:1787853116.544155:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 133 00000100:00100000:0.0:1787853116.564803:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853116.564893:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526141568 00000100:00100000:2.0:1787853116.564902:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526141568 00000100:00100000:2.0:1787853116.564972:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 134 00000100:00100000:2.0:1787853116.564982:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4910d27840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+26:10595:x1874699526141568:12345-192.168.204.1@tcp:54:lfs.0 00010000:00010000:2.0:1787853116.565068:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9c00/0x710df789068e6ac1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853116.565088:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9c00/0x710df789068e6ac1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853116.565101:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9c00/0x710df789068e6ac1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853116.565129:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9c00/0x710df789068e6ac1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853116.565136:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9c00/0x710df789068e6ac1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853116.565143:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9c00/0x710df789068e6ac1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853116.565150:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b9c00 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:2.0:1787853116.565154:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9c00/0x710df789068e6ac1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853116.565178:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9c00/0x710df789068e6ac1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853116.565190:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8f491176b200) 00010000:00010000:2.0:1787853116.565193:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787853116.565198:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9c00/0x710df789068e6ac1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853116.565205:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9c00/0x710df789068e6ac1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853116.565273:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4910d27840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+26:10595:x1874699526141568:12345-192.168.204.1@tcp:54:lfs.0 Request processed in 291us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853116.565280:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 134 00000100:00100000:1.0:1787853116.650008:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787853116.650047:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49127861c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552369664:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787853116.650136:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853116.650293:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552369664 00000100:00100000:2.0:1787853116.650301:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552369664 00000100:00100000:2.0:1787853116.650360:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787853116.650369:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4910d12940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3306:x1874699552369664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787853116.650406:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787853116.650471:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4910d12940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3306:x1874699552369664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853116.650478:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787853116.650523:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49127861c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552369664:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787853116.655684:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787853116.655713:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4910d270c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874699552369792:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787853116.655792:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853116.655912:0:10348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552369792 00000100:00100000:3.0:1787853116.655922:0:10348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552369792 00000100:00100000:3.0:1787853116.655982:0:10348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787853116.656008:0:10348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4910d112c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1874699552369792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787853116.656055:0:10348:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787853116.656125:0:10348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4910d112c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1874699552369792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 118us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853116.656133:0:10348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787853116.656312:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4910d270c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874699552369792:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787853116.698095:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853116.698209:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526141696 00000100:00100000:2.0:1787853116.698222:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526141696 00000100:00100000:2.0:1787853116.698301:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 48 00000100:00100000:2.0:1787853116.698312:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4910d270c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+6:2365:x1874699526141696:12345-192.168.204.1@tcp:101:cat.0 00010000:00010000:2.0:1787853116.698351:0:6684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853116.698375:0:6684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff26dc11/0x710df789068e6ac8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c5079389817 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787853116.698425:0:6684:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a90793a, atime: 0x6a907939, ctime: 0x6a90793a, blocks: 0xb 00010000:00010000:2.0:1787853116.698451:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=436s v=(0 0) 00010000:00010000:2.0:1787853116.698457:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787853116.698474:0:6684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff26dc11/0x710df789068e6ac8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389817 expref: 7 pid: 6684 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853116.698499:0:6684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ff26dc11/0x710df789068e6ac8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389817 expref: 7 pid: 6684 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853116.698515:0:6684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49415b9c00, rc 0) 00000100:00100000:2.0:1787853116.698633:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4910d270c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+7:2365:x1874699526141696:12345-192.168.204.1@tcp:101:cat.0 Request processed in 323us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853116.698640:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 48 00000100:00100000:1.0:1787853116.715987:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853116.732952:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526141824 00000100:00100000:3.0:1787853116.732972:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526141824 00002000:00100000:3.0:1787853116.733065:0:6687:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff8f49415a52c0 x1874699526141824/t0(0) o3->b1d98f5a-0be0-4f69-83a6-833c935c8205@192.168.204.1@tcp:292/0 lens 488/0 e 0 to 0 dl 1787853127 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787853116.733079:0:6687:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff8f49415a52c0 with x1874699526141824 ext(0->4095) 00002000:00010000:3.0:1787853116.733085:0:6687:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8f49415a52c0 00000100:00100000:3.0:1787853116.733123:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 4 00000100:00100000:3.0:1787853116.733133:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49415a52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+7:2362:x1874699526141824:12345-192.168.204.1@tcp:3:cat.0 00000100:00100000:3.0:1787853116.733433:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49415a52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+7:2362:x1874699526141824:12345-192.168.204.1@tcp:3:cat.0 Request processed in 300us (17458us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787853116.733442:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 4 00002000:00100000:3.0:1787853116.733450:0:6687:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff8f49415a52c0 x1874699526141824/t0(0) o3->b1d98f5a-0be0-4f69-83a6-833c935c8205@192.168.204.1@tcp:292/0 lens 488/4536 e 0 to 0 dl 1787853127 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787853116.733459:0:6687:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff8f49415a52c0 with x1874699526141824 ext(0->4095) 00002000:00010000:3.0:1787853116.733463:0:6687:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8f49415a52c0 00010000:00010000:0.0:1787853117.226101:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853118.257410:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787853118.268480:0:7641:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:2.0:1787853118.268505:0:7641:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:0.0:1787853118.784499:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853118.784538:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853118.784596:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853118.784632:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853118.784658:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853118.784690:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526141952 00000100:00100000:0.0:1787853118.784700:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526141952 00000100:00100000:0.0:1787853118.784754:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 298 00000100:00100000:0.0:1787853118.784764:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4906231c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af755b38-4932-400a-92cc-ddad0ca077a5+13:2363:x1874699526141952:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:0.0:1787853118.784839:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4906231c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af755b38-4932-400a-92cc-ddad0ca077a5+13:2363:x1874699526141952:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 77us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853118.784847:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 298 00000100:00100000:0.0:1787853118.784881:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526142336 00000100:00100000:0.0:1787853118.784885:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526142336 00000100:00100000:0.0:1787853118.784919:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526142208 00000100:00100000:0.0:1787853118.784922:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526142208 00000100:00100000:0.0:1787853118.784944:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 91 00000100:00100000:0.0:1787853118.784951:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4910d25e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+5:2363:x1874699526142336:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:0.0:1787853118.784993:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4910d25e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+5:2363:x1874699526142336:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 42us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853118.785000:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 91 00000100:00100000:0.0:1787853118.785013:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 92 00000100:00100000:0.0:1787853118.785019:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4910d26580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+7:2363:x1874699526142208:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:0.0:1787853118.785045:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4910d26580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+7:2363:x1874699526142208:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 26us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853118.785052:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 92 00000100:00100000:0.0:1787853118.785070:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526142080 00000100:00100000:0.0:1787853118.785073:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526142080 00000100:00100000:0.0:1787853118.785100:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526142464 00000100:00100000:0.0:1787853118.785109:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526142464 00000100:00100000:0.0:1787853118.785134:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 159 00000100:00100000:0.0:1787853118.785141:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4910d26940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+26:2363:x1874699526142080:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:0.0:1787853118.785169:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4910d26940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+26:2363:x1874699526142080:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 29us (682us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853118.785176:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 159 00000100:00100000:0.0:1787853118.785187:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 160 00000100:00100000:0.0:1787853118.785193:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493c5a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ea3b4e1-e827-460f-be07-19e86dff3d79+5:2363:x1874699526142464:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:0.0:1787853118.785215:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493c5a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ea3b4e1-e827-460f-be07-19e86dff3d79+5:2363:x1874699526142464:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 22us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853118.785220:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 160 00000100:00080000:0.0:1787853118.785522:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787853118.785527:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787853118.785529:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787853119.274731:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787853120.282364:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:1.0:1787853120.282492:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00000001:00080000:1.0:1787853120.282500:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:3.0:1787853120.292014:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967412 is committed 00000020:00080000:3.0:1787853120.292057:0:5858:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8f490664af00 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:3.0:1787853120.292063:0:5858:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8f493c767300 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8f490664a780 00000020:00080000:3.0:1787853120.292066:0:5858:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8f493c767f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8f4941589000 00000020:00080000:3.0:1787853120.292106:0:5858:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000001:00080000:3.0:1787853120.292123:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:1.0:1787853120.292187:0:5870:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:1.0:1787853120.292376:0:5870:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:3.0:1787853120.297688:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787853121.258800:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49415a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5d48a955-7010-4118-9c7d-f396984ae1ff:3309:1874699552369920:0@lo:400:kworker.0 00000100:00100000:0.0:1787853121.258885:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853121.259000:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552369920 00000100:00100000:3.0:1787853121.259009:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552369920 00000100:00100000:3.0:1787853121.259062:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1787853121.259072:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4911c02850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d48a955-7010-4118-9c7d-f396984ae1ff+19:3309:x1874699552369920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853121.261566:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49418a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874699552370048:0@lo:400:kworker.0 00000100:00100000:2.0:1787853121.261691:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853121.261749:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787853121.261757:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49418a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552370176:0@lo:400:kworker.0 00000100:00100000:2.0:1787853121.261786:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853121.261824:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552370176 00000100:00100000:2.0:1787853121.261832:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552370176 00000100:00100000:2.0:1787853121.261905:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787853121.261913:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4912787840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874699552370176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853121.261980:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4912787840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874699552370176:12345-0@lo:400:kworker.0 Request processed in 68us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853121.261986:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:2.0:1787853121.262006:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787853121.262035:0:3306:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:2.0:1787853121.262040:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8f494159c000, transno 4294967310 00000004:00080000:2.0:1787853121.262052:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8f493fd54f00, transno 4294967311 00000004:00080000:2.0:1787853121.262056:0:3306:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967313 committed transno 4294967313 00000100:00100000:2.0:1787853121.262079:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49418a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552370176:0@lo:400:kworker.0 00000100:00100000:2.0:1787853121.262125:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552370048 00000100:00100000:2.0:1787853121.262129:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552370048 00000100:00100000:2.0:1787853121.262163:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1787853121.262170:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49127861c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874699552370048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853121.262208:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49127861c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874699552370048:12345-0@lo:400:kworker.0 Request processed in 39us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853121.262214:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1787853121.262247:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49418a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874699552370048:0@lo:400:kworker.0 00000100:00100000:2.0:1787853121.262775:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49418a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1874699552370304:0@lo:400:kworker.0 00000100:00100000:2.0:1787853121.262812:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853121.262860:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552370304 00000100:00100000:2.0:1787853121.262864:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552370304 00000100:00100000:2.0:1787853121.262899:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1787853121.262906:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49127843c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874699552370304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853121.262962:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49127843c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874699552370304:12345-0@lo:400:kworker.0 Request processed in 56us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853121.262975:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00080000:2.0:1787853121.262998:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787853121.263020:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49418a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1874699552370304:0@lo:400:kworker.0 00000100:00100000:3.0:1787853121.263953:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4911c02850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d48a955-7010-4118-9c7d-f396984ae1ff+19:3309:x1874699552369920:12345-0@lo:400:kworker.0 Request processed in 4877us (5062us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853121.263967:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:0.0:1787853121.267060:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49415a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5d48a955-7010-4118-9c7d-f396984ae1ff:3309:1874699552369920:0@lo:400:kworker.0 00000100:00100000:1.0:1787853121.269181:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787853121.269207:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49418a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874699552370560:0@lo:400:kworker.0 00000100:00100000:1.0:1787853121.269286:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853121.272035:0:12025:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552370560 00000100:00100000:0.0:1787853121.272052:0:12025:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552370560 00000100:00100000:0.0:1787853121.272135:0:12025:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787853121.272147:0:12025:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49418a1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3307:x1874699552370560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853121.272236:0:12025:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49418a1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3307:x1874699552370560:12345-0@lo:400:kworker.0 Request processed in 93us (2950us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853121.272244:0:12025:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787853121.272279:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49418a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1874699552370432:0@lo:400:kworker.0 00000100:00100000:0.0:1787853121.272338:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853121.272369:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552370432 00000100:00100000:0.0:1787853121.272373:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552370432 00000100:00100000:0.0:1787853121.272403:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1787853121.272410:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4910d24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874699552370432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853121.272439:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4910d24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874699552370432:12345-0@lo:400:kworker.0 Request processed in 30us (102us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853121.272445:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1787853121.272484:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49418a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1874699552370432:0@lo:400:kworker.0 00000100:00080000:2.0:1787853121.276846:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787853121.276860:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787853121.277025:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:1.0:1787853121.277035:0:3307:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:1.0:1787853121.277058:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8f49056ded00, transno 4294967304 00000100:00100000:1.0:1787853121.277088:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49418a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874699552370560:0@lo:400:kworker.0 00010000:00010000:1.0:1787853121.322116:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787853121.322329:0:11690:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787853121.322335:0:11690:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787853121.322376:0:11690:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1787853121.322385:0:11690:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787853121.769822:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787853121.769850:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4910d25680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552370688:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787853121.769944:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853121.769968:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552370688 00000100:00100000:1.0:1787853121.769977:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552370688 00000100:00100000:1.0:1787853121.770033:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787853121.770044:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49415a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874699552370688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787853121.770102:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787853121.770164:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49415a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874699552370688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 122us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853121.770171:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787853121.770619:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4910d25680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552370688:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787853121.770869:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49418a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874699552370816:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787853121.770909:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853121.770993:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552370816 00000100:00100000:3.0:1787853121.770999:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552370816 00000100:00100000:3.0:1787853121.771048:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787853121.771057:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49127870c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874699552370816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787853121.771162:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787853121.777298:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49127870c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874699552370816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 6225us (6371us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853121.777314:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787853121.782026:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49418a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874699552370816:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787853122.356863:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787853123.369781:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787853123.441880:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853123.442013:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526142592 00000100:00100000:2.0:1787853123.442022:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526142592 00000100:00100000:2.0:1787853123.442108:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 135 00000100:00100000:2.0:1787853123.442119:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49418a0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+13:10256:x1874699526142592:12345-192.168.204.1@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1787853123.442233:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49418a0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+13:10256:x1874699526142592:12345-192.168.204.1@tcp:60:lhsmtool_posix.0 Request processed in 117us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853123.442241:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 135 00000100:00080000:0.0:1787853123.442623:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787853123.447723:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853123.447816:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526142848 00000100:00100000:3.0:1787853123.447827:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526142848 00000100:00100000:3.0:1787853123.447896:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 35 00000100:00100000:3.0:1787853123.447907:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4910d25680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+13:10256:x1874699526142848:12345-192.168.204.1@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787853123.448426:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4910d25680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+14:10256:x1874699526142848:12345-192.168.204.1@tcp:35:lhsmtool_posix.0 Request processed in 519us (713us total) trans 4294967414 rc 0/0 00000100:00100000:3.0:1787853123.448434:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 35 00000100:00100000:1.0:1787853123.729486:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853123.729681:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526142976 00000100:00100000:0.0:1787853123.729692:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526142976 00000100:00100000:0.0:1787853123.729773:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 136 00000100:00100000:0.0:1787853123.729784:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49418a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ea3b4e1-e827-460f-be07-19e86dff3d79+5:11047:x1874699526142976:12345-192.168.204.1@tcp:101:lsof.0 00010000:00010000:0.0:1787853123.729808:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853123.729829:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7400/0x710df789068e6acf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c507938981e expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853123.729911:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6800/0x710df789068e6ad6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853123.729945:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6800/0x710df789068e6ad6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853123.729959:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6800/0x710df789068e6ad6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787853123.730249:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787853123.730253:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000100:00080000:2.0:1787853123.730322:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00010000:0.0:1787853123.730370:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6800/0x710df789068e6ad6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853123.730398:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7400/0x710df789068e6acf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c507938981e expref: 7 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853123.730421:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6800/0x710df789068e6ad6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c507938981e expref: 6 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853123.730431:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f491176be00) 00010000:00010000:0.0:1787853123.730433:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787853123.730437:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49415b6800, rc 0) 00000100:00100000:0.0:1787853123.730736:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49418a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ea3b4e1-e827-460f-be07-19e86dff3d79+6:11047:x1874699526142976:12345-192.168.204.1@tcp:101:lsof.0 Request processed in 951us (1259us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853123.730744:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 136 00000100:00100000:1.0:1787853123.906308:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853123.906421:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853123.906456:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853123.906498:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853123.906543:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526143360 00000100:00100000:1.0:1787853123.906553:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526143360 00000100:00100000:2.0:1787853123.906693:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526143232 00000100:00100000:2.0:1787853123.906698:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526143232 00000100:00100000:2.0:1787853123.906741:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 164 00000100:00100000:2.0:1787853123.906751:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49418a2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+14:2363:x1874699526143232:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:2.0:1787853123.906828:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49418a2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+14:2363:x1874699526143232:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 78us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853123.906850:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 164 00000100:00080000:2.0:1787853123.906902:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787853123.907339:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526143488 00000100:00100000:1.0:1787853123.907344:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526143488 00000100:00100000:1.0:1787853123.907376:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 95 00000100:00100000:1.0:1787853123.907384:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49418a1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+6:2363:x1874699526143360:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:1.0:1787853123.907424:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49418a1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+6:2363:x1874699526143360:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 41us (1003us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853123.907431:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 95 00000100:00100000:1.0:1787853123.907443:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 96 00000100:00100000:1.0:1787853123.907450:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49418a12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+5:2363:x1874699526143488:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:1.0:1787853123.907473:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49418a12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+5:2363:x1874699526143488:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 24us (975us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853123.907490:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 96 00000100:00080000:2.0:1787853123.907771:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787853123.908251:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526143104 00000100:00100000:0.0:1787853123.908257:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526143104 00000100:00100000:0.0:1787853123.908341:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 300 00000100:00100000:0.0:1787853123.908350:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4906232050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af755b38-4932-400a-92cc-ddad0ca077a5+13:2363:x1874699526143104:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:0.0:1787853123.908397:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4906232050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af755b38-4932-400a-92cc-ddad0ca077a5+13:2363:x1874699526143104:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 49us (2099us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853123.908415:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 300 00010000:00010000:1.0:1787853124.395191:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853125.418592:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1787853125.426034:0:5858:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000001:00080000:3.0:1787853125.426115:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:0.0:1787853125.426649:0:5870:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:0.0:1787853125.426661:0:5870:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:0.0:1787853126.378387:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4912785680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5d48a955-7010-4118-9c7d-f396984ae1ff:3309:1874699552370944:0@lo:400:kworker.0 00000100:00100000:0.0:1787853126.378483:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853126.378555:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4912786d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1874699552371456:0@lo:400:kworker.0 00000100:00100000:0.0:1787853126.378631:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853126.378662:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787853126.378668:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4912786580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1874699552371328:0@lo:400:kworker.0 00000100:00100000:0.0:1787853126.378692:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853126.378724:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552371456 00000100:00100000:0.0:1787853126.378731:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552371456 00000100:00100000:0.0:1787853126.378783:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552371328 00000100:00100000:0.0:1787853126.378786:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552371328 00000100:00100000:0.0:1787853126.378809:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1787853126.378817:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4908ca70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874699552371456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853126.379698:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4908ca70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874699552371456:12345-0@lo:400:kworker.0 Request processed in 878us (1062us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853126.379708:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1787853126.379746:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1787853126.379755:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4908ca5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874699552371328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853126.379786:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4908ca5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874699552371328:12345-0@lo:400:kworker.0 Request processed in 33us (1093us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853126.379792:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1787853126.379985:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552370944 00000100:00100000:2.0:1787853126.379992:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552370944 00000100:00100000:2.0:1787853126.380025:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:2.0:1787853126.380033:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4906232850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d48a955-7010-4118-9c7d-f396984ae1ff+19:3309:x1874699552370944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853126.380074:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4906232850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d48a955-7010-4118-9c7d-f396984ae1ff+19:3309:x1874699552370944:12345-0@lo:400:kworker.0 Request processed in 42us (1592us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853126.380080:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00080000:2.0:1787853126.380121:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787853126.380234:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4912786580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1874699552371328:0@lo:400:kworker.0 00000100:00100000:0.0:1787853126.380261:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4912785680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5d48a955-7010-4118-9c7d-f396984ae1ff:3309:1874699552370944:0@lo:400:kworker.0 00000100:00100000:0.0:1787853126.380272:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4912786d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1874699552371456:0@lo:400:kworker.0 00000100:00100000:3.0:1787853126.380377:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4912785e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874699552371200:0@lo:400:kworker.0 00000100:00100000:3.0:1787853126.380429:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853126.380468:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787853126.380476:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4912786940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874699552371072:0@lo:400:kworker.0 00000100:00100000:3.0:1787853126.380499:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853126.380526:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4912787480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874699552371584:0@lo:400:kworker.0 00000100:00100000:3.0:1787853126.380558:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853126.380603:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552371072 00000100:00100000:3.0:1787853126.380607:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552371072 00000100:00100000:3.0:1787853126.380632:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1787853126.380639:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493beea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874699552371072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853126.380675:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493beea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874699552371072:12345-0@lo:400:kworker.0 Request processed in 36us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853126.380681:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1787853126.380707:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4912786940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874699552371072:0@lo:400:kworker.0 00000100:00100000:0.0:1787853126.381249:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552371200 00000100:00100000:0.0:1787853126.381256:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552371200 00000100:00100000:0.0:1787853126.381307:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552371584 00000100:00100000:0.0:1787853126.381310:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552371584 00000100:00100000:0.0:1787853126.381335:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787853126.381352:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493bee9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874699552371200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853126.381653:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493bee9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874699552371200:12345-0@lo:400:kworker.0 Request processed in 311us (1223us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853126.381661:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787853126.381675:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787853126.381682:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49031c2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874699552371584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853126.381713:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49031c2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874699552371584:12345-0@lo:400:kworker.0 Request processed in 33us (1154us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853126.381718:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787853126.381758:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4912787480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874699552371584:0@lo:400:kworker.0 00000100:00100000:0.0:1787853126.381768:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4912785e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874699552371200:0@lo:400:kworker.0 00000100:00080000:2.0:1787853126.382382:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787853126.382387:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787853126.443188:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787853126.890040:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787853126.890064:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49418a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552371712:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787853126.890155:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853126.890364:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552371712 00000100:00100000:1.0:1787853126.890390:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552371712 00000100:00100000:1.0:1787853126.890458:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787853126.890469:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4912787c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874699552371712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787853126.890512:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787853126.890604:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4912787c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874699552371712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853126.890613:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787853126.891414:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49418a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552371712:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787853126.894792:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787853126.894829:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49418a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874699552371840:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787853126.894902:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853126.895187:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552371840 00000100:00100000:2.0:1787853126.895195:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552371840 00000100:00100000:2.0:1787853126.895251:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787853126.895260:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4908ca6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874699552371840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787853126.895296:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787853126.895351:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4908ca6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874699552371840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853126.895359:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787853126.895464:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49418a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874699552371840:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787853127.469715:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787853127.950707:0:12264:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 13:52:06 (1787853126) 00010000:00010000:2.0:1787853128.493309:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787853129.026470:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853129.026516:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853129.026549:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853129.026635:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526143744 00000100:00100000:3.0:1787853129.026646:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526143744 00000100:00100000:3.0:1787853129.026722:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 168 00000100:00100000:3.0:1787853129.026733:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49127852c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+13:2362:x1874699526143744:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:3.0:1787853129.026825:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49127852c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+13:2362:x1874699526143744:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 95us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853129.026832:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 168 00000100:00080000:3.0:1787853129.027004:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787853129.029334:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526144000 00000100:00100000:0.0:1787853129.029352:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526144000 00000100:00100000:0.0:1787853129.029464:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 99 00000100:00100000:0.0:1787853129.029476:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4912784f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+5:2362:x1874699526144000:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:0.0:1787853129.029556:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4912784f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+5:2362:x1874699526144000:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 82us (3038us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853129.029563:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 99 00000100:00100000:2.0:1787853129.030183:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853129.030225:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853129.030249:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526144128 00000100:00100000:2.0:1787853129.030256:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526144128 00000100:00100000:2.0:1787853129.030295:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 169 00000100:00100000:2.0:1787853129.030303:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4912784000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ea3b4e1-e827-460f-be07-19e86dff3d79+6:2362:x1874699526144128:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:2.0:1787853129.030353:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4912784000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ea3b4e1-e827-460f-be07-19e86dff3d79+6:2362:x1874699526144128:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 51us (128us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853129.030360:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 169 00000100:00080000:3.0:1787853129.031130:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787853129.031136:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787853129.034765:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526143872 00000100:00100000:0.0:1787853129.034794:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526143872 00000100:00100000:0.0:1787853129.034898:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 100 00000100:00100000:0.0:1787853129.034912:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4912785a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+6:2362:x1874699526143872:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:0.0:1787853129.035023:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4912785a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+6:2362:x1874699526143872:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 115us (4842us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853129.035031:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 100 00000100:00080000:3.0:1787853129.036299:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787853129.039163:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526143616 00000100:00100000:1.0:1787853129.039178:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526143616 00000100:00100000:3.0:1787853129.044919:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 302 00000100:00100000:3.0:1787853129.044933:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4906233450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af755b38-4932-400a-92cc-ddad0ca077a5+13:2362:x1874699526143616:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:3.0:1787853129.045629:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4906233450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af755b38-4932-400a-92cc-ddad0ca077a5+13:2362:x1874699526143616:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 694us (19074us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853129.045639:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 302 00000100:00100000:3.0:1787853129.511021:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853129.512851:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526144384 00000100:00100000:0.0:1787853129.512865:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526144384 00000100:00100000:0.0:1787853129.513064:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 137 00000100:00100000:0.0:1787853129.513078:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493fdd5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+13:11312:x1874699526144384:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787853129.513111:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853129.513135:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6400/0x710df789068e6add lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c5079389825 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853129.513232:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e6ae4 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853129.513247:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e6ae4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853129.513261:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e6ae4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853129.513294:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6600/0x710df789068e6aeb lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853129.513302:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6600/0x710df789068e6aeb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853129.513310:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6600/0x710df789068e6aeb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853129.514149:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7400/0x710df789068e6af2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853129.514161:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7400/0x710df789068e6af2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853129.514169:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7400/0x710df789068e6af2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787853129.514180:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:0.0:1787853129.514921:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e6ae4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853129.514931:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e6ae4 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853129.514938:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e6ae4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853129.514945:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b6200 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:0.0:1787853129.514954:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e6ae4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853129.514974:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e6ae4 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853129.514988:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8f4910f92900) 00010000:00010000:0.0:1787853129.514991:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787853129.514995:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e6ae4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853129.515001:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e6ae4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853129.515017:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6600/0x710df789068e6aeb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853129.515023:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6600/0x710df789068e6aeb lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853129.515029:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6600/0x710df789068e6aeb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853129.515034:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b6600 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:0.0:1787853129.515037:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6600/0x710df789068e6aeb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853129.515043:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6600/0x710df789068e6aeb lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853129.515050:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8f491176b300) 00010000:00010000:0.0:1787853129.515052:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787853129.515055:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6600/0x710df789068e6aeb lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853129.515071:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6600/0x710df789068e6aeb lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853129.520304:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853129.520459:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6400/0x710df789068e6add lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389825 expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853129.520688:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7400/0x710df789068e6af2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389825 expref: 15 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853129.520698:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f4914d11600) 00010000:00010000:0.0:1787853129.520701:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787853129.520704:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49415b7400, rc 0) 00000100:00100000:0.0:1787853129.520993:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493fdd5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+15:11312:x1874699526144384:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 Request processed in 7916us (9978us total) trans 4294967415 rc 0/0 00000100:00100000:0.0:1787853129.521003:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 137 00000100:00100000:1.0:1787853129.533736:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853129.533948:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853129.534229:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526144640 00000100:00100000:3.0:1787853129.534241:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526144640 00000100:00100000:3.0:1787853129.534312:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 138 00000100:00100000:3.0:1787853129.534324:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49418a03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+15:11312:x1874699526144640:12345-192.168.204.1@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1787853129.534486:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49418a03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+15:11312:x1874699526144640:12345-192.168.204.1@tcp:59:lhsmtool_posix.0 Request processed in 156us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853129.534493:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 138 00000100:00100000:2.0:1787853129.539907:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526144512 00000100:00100000:2.0:1787853129.539925:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526144512 00000100:00100000:2.0:1787853129.540004:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 9 00000100:00100000:2.0:1787853129.540016:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4905684850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+15:2364:x1874699526144512:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787853129.540034:0:8450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787853129.540063:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7400/0x710df789068e6af2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389825 expref: 15 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853129.540097:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f4914d11600) 00010000:00010000:2.0:1787853129.540103:0:8450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787853129.540176:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4905684850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+14:2364:x1874699526144512:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 162us (6452us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853129.540184:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 9 00010000:00010000:1.0:1787853130.537937:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787853130.540227:0:11690:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787853130.540249:0:11690:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787853130.545663:0:11690:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1787853130.545682:0:11690:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:3.0:1787853130.553677:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000100:00100000:1.0:1787853131.499827:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f493c5fcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874699552372096:0@lo:400:kworker.0 00000100:00100000:1.0:1787853131.499919:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853131.499976:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f493c5fed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552372608:0@lo:400:kworker.0 00000100:00100000:1.0:1787853131.500001:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853131.500037:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787853131.500044:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f493c5ff840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552372224:0@lo:400:kworker.0 00000100:00100000:1.0:1787853131.500066:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853131.500106:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552372096 00000100:00100000:1.0:1787853131.500114:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552372096 00000100:00100000:1.0:1787853131.500164:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1787853131.500173:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f48039f1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874699552372096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853131.500226:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f48039f1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874699552372096:12345-0@lo:400:kworker.0 Request processed in 55us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853131.500233:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1787853131.500268:0:12025:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552372608 00000100:00100000:1.0:1787853131.500271:0:12025:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552372608 00000100:00100000:1.0:1787853131.500306:0:12025:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552372224 00000100:00100000:1.0:1787853131.500308:0:12025:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552372224 00000100:00100000:1.0:1787853131.500325:0:12025:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787853131.500330:0:12025:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f48039f03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3306:x1874699552372608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853131.500359:0:12025:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f48039f03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3306:x1874699552372608:12345-0@lo:400:kworker.0 Request processed in 29us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853131.500365:0:12025:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787853131.500375:0:12025:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787853131.500380:0:12025:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f48039f2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3306:x1874699552372224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853131.500403:0:12025:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f48039f2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3306:x1874699552372224:12345-0@lo:400:kworker.0 Request processed in 23us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853131.500408:0:12025:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:1.0:1787853131.500429:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787853131.500433:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787853131.500601:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4921697840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5d48a955-7010-4118-9c7d-f396984ae1ff:3309:1874699552371968:0@lo:400:kworker.0 00000100:00100000:0.0:1787853131.500639:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853131.500669:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f493c5fde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1874699552372480:0@lo:400:kworker.0 00000100:00100000:0.0:1787853131.500691:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853131.500708:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787853131.500714:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f493c5fda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1874699552372352:0@lo:400:kworker.0 00000100:00100000:0.0:1787853131.500749:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853131.500776:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552371968 00000100:00100000:0.0:1787853131.500780:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552371968 00000100:00100000:0.0:1787853131.500810:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1787853131.500817:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4906232450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+19:3309:x1874699552371968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853131.500861:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4906232450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+19:3309:x1874699552371968:12345-0@lo:400:kworker.0 Request processed in 44us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853131.500867:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1787853131.500906:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4921697840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5d48a955-7010-4118-9c7d-f396984ae1ff:3309:1874699552371968:0@lo:400:kworker.0 00000100:00100000:0.0:1787853131.500951:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552372480 00000100:00100000:0.0:1787853131.500955:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552372480 00000100:00100000:0.0:1787853131.500982:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552372352 00000100:00100000:0.0:1787853131.500984:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552372352 00000100:00100000:0.0:1787853131.501003:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1787853131.501009:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4908ca6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874699552372480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853131.501041:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4908ca6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874699552372480:12345-0@lo:400:kworker.0 Request processed in 33us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853131.501047:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1787853131.501057:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1787853131.501062:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4908ca6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874699552372352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853131.501086:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4908ca6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874699552372352:12345-0@lo:400:kworker.0 Request processed in 25us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853131.501091:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1787853131.501114:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f493c5fda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1874699552372352:0@lo:400:kworker.0 00000100:00100000:0.0:1787853131.501123:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f493c5fde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1874699552372480:0@lo:400:kworker.0 00000100:00080000:0.0:1787853131.501146:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787853131.501225:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f493c5ff840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552372224:0@lo:400:kworker.0 00000100:00100000:1.0:1787853131.501243:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f493c5fcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874699552372096:0@lo:400:kworker.0 00000100:00100000:1.0:1787853131.501255:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f493c5fed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552372608:0@lo:400:kworker.0 00010000:00010000:2.0:1787853131.573223:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787853131.578306:0:11690:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787853131.578316:0:11690:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787853131.578843:0:11690:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:1.0:1787853131.578852:0:11690:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787853131.644992:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853131.645076:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526144768 00000100:00100000:0.0:1787853131.645088:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526144768 00000100:00100000:0.0:1787853131.645183:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 139 00000100:00100000:0.0:1787853131.645194:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493fdd6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+13:11354:x1874699526144768:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:0.0:1787853131.645234:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853131.645259:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6e00/0x710df789068e6b00 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c507938982c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853131.645349:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7600/0x710df789068e6b07 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853131.645367:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7600/0x710df789068e6b07 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853131.645380:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7600/0x710df789068e6b07 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853131.645395:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6a00/0x710df789068e6b0e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853131.645401:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6a00/0x710df789068e6b0e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853131.645407:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6a00/0x710df789068e6b0e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853131.645779:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7600/0x710df789068e6b07 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853131.645787:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7600/0x710df789068e6b07 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853131.645793:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7600/0x710df789068e6b07 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853131.645798:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b7600 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:0.0:1787853131.645808:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7600/0x710df789068e6b07 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853131.645816:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7600/0x710df789068e6b07 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853131.645876:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f491176be00) 00010000:00010000:0.0:1787853131.645880:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787853131.645885:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7600/0x710df789068e6b07 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853131.645893:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7600/0x710df789068e6b07 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853131.645907:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6a00/0x710df789068e6b0e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853131.645913:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6a00/0x710df789068e6b0e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853131.645919:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6a00/0x710df789068e6b0e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853131.645923:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b6a00 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:0.0:1787853131.645926:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6a00/0x710df789068e6b0e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853131.645932:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6a00/0x710df789068e6b0e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853131.645940:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8f491176b900) 00010000:00010000:0.0:1787853131.645942:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787853131.645951:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6a00/0x710df789068e6b0e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853131.645957:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6a00/0x710df789068e6b0e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853131.645989:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6e00/0x710df789068e6b00 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c507938982c expref: 14 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853131.645999:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f491176be00) 00010000:00010000:0.0:1787853131.646002:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787853131.646005:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6e00/0x710df789068e6b00 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c507938982c expref: 14 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853131.646013:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49415b6e00, rc 0) 00000100:00100000:0.0:1787853131.646081:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493fdd6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+13:11354:x1874699526144768:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 889us (1100us total) trans 0 rc 301/301 00000100:00100000:0.0:1787853131.646089:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 139 00000100:00080000:3.0:1787853131.648806:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787853131.661913:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853131.661993:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526145024 00000100:00100000:1.0:1787853131.662005:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526145024 00000100:00100000:1.0:1787853131.662073:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 140 00000100:00100000:1.0:1787853131.662084:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4908ca7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+13:11354:x1874699526145024:12345-192.168.204.1@tcp:36:lfs.0 00010000:00010000:1.0:1787853131.662157:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787853131.662187:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7800/0x710df789068e647e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389665 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853131.662206:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f491176be00) 00010000:00010000:1.0:1787853131.662211:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787853131.662530:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad800/0x710df789068e6b15 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853131.662545:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6800/0x710df789068e6ad6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c507938981e expref: 5 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853131.662554:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad800/0x710df789068e6b15 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853131.662623:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6800/0x710df789068e6ad6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.1@tcp remote: 0xd0a9c507938981e expref: 5 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853131.662638:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6800/0x710df789068e6ad6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c507938981e expref: 5 pid: 5837 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853131.662653:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f48039f2580 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5838:1874699552372736:192.168.204.1@tcp:104: 00000100:00100000:1.0:1787853131.662770:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f493c5a0e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787853131.667952:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853131.667983:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526145152 00000100:00100000:3.0:1787853131.667993:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526145152 00010000:00010000:3.0:1787853131.668049:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6800/0x710df789068e6ad6 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c507938981e expref: 6 pid: 5837 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853131.668087:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 60 00000100:00100000:3.0:1787853131.668116:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493fdd7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ea3b4e1-e827-460f-be07-19e86dff3d79+6:2363:x1874699526145152:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787853131.668133:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787853131.668140:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6800/0x710df789068e6ad6 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c507938981e expref: 6 pid: 5837 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853131.668154:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6800/0x710df789068e6ad6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c507938981e expref: 6 pid: 5837 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853131.668178:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f491176be00) 00010000:00010000:3.0:1787853131.668184:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad800/0x710df789068e6b15 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853131.668193:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad800/0x710df789068e6b15 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853131.668200:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad800/0x710df789068e6b15 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853131.668219:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787853131.668272:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493fdd7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ea3b4e1-e827-460f-be07-19e86dff3d79+6:2363:x1874699526145152:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 158us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853131.668279:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 60 00000100:00080000:3.0:1787853131.668413:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787853131.668448:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6800/0x710df789068e6ad6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c507938981e expref: 5 pid: 5837 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853131.668483:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f48039f2580 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5838:1874699552372736:192.168.204.1@tcp:104: 00010000:00010000:3.0:1787853131.668504:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad800/0x710df789068e6b15 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853131.668521:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad800/0x710df789068e6b15 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853131.668527:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad800/0x710df789068e6b15 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853131.668553:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20400/0x710df789068e6b1c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853131.668564:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20400/0x710df789068e6b1c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853131.668598:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20400/0x710df789068e6b1c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787853131.669769:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1787853131.669784:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad800/0x710df789068e6b15 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853131.669792:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad800/0x710df789068e6b15 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853131.669799:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad800/0x710df789068e6b15 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853131.669806:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f492a8ad800 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:3.0:1787853131.669812:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad800/0x710df789068e6b15 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853131.669820:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad800/0x710df789068e6b15 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853131.669847:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f491176be00) 00010000:00010000:3.0:1787853131.669850:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787853131.669855:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad800/0x710df789068e6b15 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853131.669862:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad800/0x710df789068e6b15 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787853131.669880:0:5838:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000058e2aff8 reply state 0000000006cd6c35 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20400/0x710df789068e6b1c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853131.669889:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787853131.669976:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4908ca7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+14:11354:x1874699526145024:12345-192.168.204.1@tcp:36:lfs.0 Request processed in 7892us (8074us total) trans 4294967416 rc 0/0 00000100:00100000:3.0:1787853131.669985:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 140 00010000:00010000:3.0:1787853131.696359:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20400/0x710df789068e6b1c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853131.696380:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20400/0x710df789068e6b1c lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853131.696388:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20400/0x710df789068e6b1c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853131.696394:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4921e20400 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:3.0:1787853131.696399:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20400/0x710df789068e6b1c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853131.696407:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20400/0x710df789068e6b1c lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853131.696438:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8f4910f92f00) 00010000:00010000:3.0:1787853131.696441:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787853131.696446:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20400/0x710df789068e6b1c lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853131.696463:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20400/0x710df789068e6b1c lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853131.798147:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853131.798260:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526145280 00000100:00100000:1.0:1787853131.798271:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526145280 00000100:00100000:1.0:1787853131.798349:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 141 00000100:00100000:1.0:1787853131.798359:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4908ca7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+13:11362:x1874699526145280:12345-192.168.204.1@tcp:101:lctl.0 00010000:00010000:1.0:1787853131.798385:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853131.798424:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ada00/0x710df789068e6b23 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c5079389833 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853131.798515:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad800/0x710df789068e6b2a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853131.798532:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad800/0x710df789068e6b2a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853131.798546:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad800/0x710df789068e6b2a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787853131.798643:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787853131.798647:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1787853131.798677:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad800/0x710df789068e6b2a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853131.798703:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ada00/0x710df789068e6b23 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389833 expref: 15 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853131.798732:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad800/0x710df789068e6b2a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389833 expref: 14 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853131.798744:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f4914d11200) 00010000:00010000:1.0:1787853131.798747:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787853131.798751:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f492a8ad800, rc 0) 00000100:00100000:1.0:1787853131.798825:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4908ca7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+14:11362:x1874699526145280:12345-192.168.204.1@tcp:101:lctl.0 Request processed in 468us (691us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853131.798834:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 141 00000100:00100000:0.0:1787853131.934944:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853131.935043:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526145408 00000100:00100000:3.0:1787853131.935054:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526145408 00000100:00100000:3.0:1787853131.935122:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 142 00000100:00100000:3.0:1787853131.935134:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4908ca4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+14:11368:x1874699526145408:12345-192.168.204.1@tcp:101:bash.0 00010000:00010000:3.0:1787853131.935155:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853131.935174:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20400/0x710df789068e6b31 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c507938983a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853131.935245:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e6b38 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853131.935261:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e6b38 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853131.935274:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e6b38 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853131.935289:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e6b3f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853131.935297:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e6b3f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853131.935320:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e6b3f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853131.935436:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20a00/0x710df789068e6b46 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853131.935445:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20a00/0x710df789068e6b46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853131.935452:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20a00/0x710df789068e6b46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787853131.935493:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:3.0:1787853131.935497:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787853131.935526:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20a00/0x710df789068e6b46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853131.935539:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e6b38 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853131.935546:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e6b38 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853131.935554:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e6b38 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853131.935561:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4921e20000 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:3.0:1787853131.935565:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e6b38 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853131.935623:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e6b38 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853131.935643:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f4914d11200) 00010000:00010000:3.0:1787853131.935647:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787853131.935652:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e6b38 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853131.935660:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e6b38 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853131.935676:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e6b3f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853131.935684:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e6b3f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853131.935690:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e6b3f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853131.935695:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4921e20c00 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:3.0:1787853131.935698:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e6b3f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853131.935704:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e6b3f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853131.935710:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8f4910f92f00) 00010000:00010000:3.0:1787853131.935713:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787853131.935716:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e6b3f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853131.935744:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e6b3f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853131.935785:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20400/0x710df789068e6b31 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c507938983a expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853131.935798:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20a00/0x710df789068e6b46 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c507938983a expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853131.935806:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8f4910f92100) 00010000:00010000:3.0:1787853131.935808:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787853131.935810:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4921e20a00, rc 0) 00000100:00100000:3.0:1787853131.935864:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4908ca4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+15:11368:x1874699526145408:12345-192.168.204.1@tcp:101:bash.0 Request processed in 734us (932us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853131.935872:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 142 00000100:00100000:0.0:1787853131.954643:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853131.954745:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526145664 00000100:00100000:1.0:1787853131.954774:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526145664 00000100:00100000:1.0:1787853131.954837:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 143 00000100:00100000:1.0:1787853131.954847:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4908ca52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+15:11368:x1874699526145664:12345-192.168.204.1@tcp:101:bash.0 00010000:00010000:1.0:1787853131.954868:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853131.954889:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ada00/0x710df789068e6b4d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c5079389841 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853131.955034:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e6b54 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853131.955049:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e6b54 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853131.955062:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e6b54 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853131.955114:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ac000/0x710df789068e6b5b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853131.955121:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ac000/0x710df789068e6b5b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853131.955127:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ac000/0x710df789068e6b5b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787853131.956121:0:5836:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:1.0:1787853131.956297:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad000/0x710df789068e6b62 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853131.956309:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad000/0x710df789068e6b62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853131.957665:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad000/0x710df789068e6b62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853131.957752:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e6b54 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853131.957761:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e6b54 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853131.957769:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e6b54 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853131.957776:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f492a8ad200 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:1.0:1787853131.957780:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e6b54 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853131.957789:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e6b54 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853131.957803:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8f4910f92100) 00010000:00010000:1.0:1787853131.958071:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787853131.958077:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e6b54 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853131.958084:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e6b54 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787853131.958102:0:5836:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b08c2d58 reply state 000000008688de9a transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ac000/0x710df789068e6b5b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853131.958111:0:5836:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787853131.958170:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ada00/0x710df789068e6b4d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389841 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853131.958187:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad000/0x710df789068e6b62 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389841 expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853131.958194:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f4914d11800) 00010000:00010000:1.0:1787853131.958197:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787853131.958200:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f492a8ad000, rc 0) 00000100:00100000:1.0:1787853131.958408:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4908ca52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+18:11368:x1874699526145664:12345-192.168.204.1@tcp:101:bash.0 Request processed in 3561us (3775us total) trans 4294967417 rc 0/0 00000100:00100000:1.0:1787853131.958417:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 143 00010000:00010000:2.0:1787853131.968337:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ac000/0x710df789068e6b5b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853131.968355:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ac000/0x710df789068e6b5b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853131.968362:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ac000/0x710df789068e6b5b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853131.968368:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f492a8ac000 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:2.0:1787853131.968373:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ac000/0x710df789068e6b5b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853131.968383:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ac000/0x710df789068e6b5b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853131.968402:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8f4914d11700) 00010000:00010000:2.0:1787853131.968405:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787853131.968410:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ac000/0x710df789068e6b5b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853131.968416:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ac000/0x710df789068e6b5b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853131.972997:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853131.973287:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526145792 00000100:00100000:2.0:1787853131.973297:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526145792 00000100:00080000:3.0:1787853131.973365:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787853131.973382:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 49 00000100:00100000:2.0:1787853131.973393:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4908ca4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+5:2362:x1874699526145792:12345-192.168.204.1@tcp:101:bash.0 00010000:00010000:2.0:1787853131.973432:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853131.973495:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000881192f3/0x710df789068e6b70 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c5079389848 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787853131.973528:0:6681:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787853131.973548:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=451s v=(0 0) 00010000:00010000:2.0:1787853131.973552:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787853131.973562:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000881192f3/0x710df789068e6b70 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389848 expref: 6 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853131.973624:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000881192f3/0x710df789068e6b70 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389848 expref: 6 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853131.973639:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49415b8c00, rc 0) 00000100:00100000:2.0:1787853131.973700:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4908ca4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+6:2362:x1874699526145792:12345-192.168.204.1@tcp:101:bash.0 Request processed in 309us (714us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853131.973708:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 49 00000100:00100000:0.0:1787853131.994691:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853131.994804:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526145920 00000100:00100000:1.0:1787853131.994817:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526145920 00000100:00100000:1.0:1787853131.994892:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 50 00000100:00100000:1.0:1787853131.994902:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4908ca5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+6:11368:x1874699526145920:12345-192.168.204.1@tcp:101:bash.0 00010000:00010000:1.0:1787853131.994923:0:8463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853131.994944:0:8463:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003e07b8dd/0x710df789068e6b77 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c507938984f expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853131.994980:0:8463:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000881192f3/0x710df789068e6b70 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389848 expref: 7 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853131.994989:0:8463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787853131.994992:0:8463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787853131.994997:0:8463:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003e07b8dd/0x710df789068e6b77 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c507938984f expref: 7 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853131.995053:0:8463:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000881192f3/0x710df789068e6b70 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389848 expref: 7 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853131.995067:0:8463:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000881192f3/0x710df789068e6b70 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389848 expref: 7 pid: 6681 timeout: 551 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853131.995079:0:8463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f48039f2580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8463:1874699552372864:192.168.204.1@tcp:104: 00000100:00100000:1.0:1787853131.995186:0:8463:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f493c5a0e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787853132.004330:0:8463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f48039f2580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8463:1874699552372864:192.168.204.1@tcp:104: 00010000:00010000:0.0:1787853132.004373:0:8463:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003e07b8dd/0x710df789068e6b77 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.1@tcp remote: 0xd0a9c507938984f expref: 7 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853132.004425:0:8463:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f492a8ada00, rc 0) 00000100:00100000:0.0:1787853132.004498:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4908ca5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+7:11368:x1874699526145920:12345-192.168.204.1@tcp:101:bash.0 Request processed in 9597us (9820us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853132.004507:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 50 00000100:00100000:3.0:1787853132.004620:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853132.005512:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526146048 00000100:00100000:2.0:1787853132.005522:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526146048 00010000:00010000:2.0:1787853132.005562:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000881192f3/0x710df789068e6b70 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389848 expref: 7 pid: 6681 timeout: 551 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853132.005638:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 61 00000100:00100000:2.0:1787853132.005648:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493fdd7c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+7:2362:x1874699526146048:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787853132.005662:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787853132.005686:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000881192f3/0x710df789068e6b70 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389848 expref: 7 pid: 6681 timeout: 551 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853132.005712:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000881192f3/0x710df789068e6b70 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389848 expref: 7 pid: 6681 timeout: 551 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853132.005747:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000881192f3/0x710df789068e6b70 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389848 expref: 7 pid: 6681 timeout: 551 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853132.005764:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787853132.005768:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787853132.005776:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003e07b8dd/0x710df789068e6b77 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.1@tcp remote: 0xd0a9c507938984f expref: 6 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853132.005786:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003e07b8dd/0x710df789068e6b77 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.1@tcp remote: 0xd0a9c507938984f expref: 6 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853132.005822:0:5823:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003e07b8dd/0x710df789068e6b77 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.1@tcp remote: 0xd0a9c507938984f expref: 6 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853132.005838:0:5823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4912784b40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5823:1874699552372992:192.168.204.1@tcp:105: 00000100:00100000:2.0:1787853132.006072:0:5823:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f492a8a2840 going to sleep for 11 seconds 00000100:00100000:2.0:1787853132.010079:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4908ca4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874699552373120:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787853132.010170:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853132.010235:0:10348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552373120 00000100:00100000:2.0:1787853132.010243:0:10348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552373120 00000100:00100000:2.0:1787853132.010293:0:10348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787853132.010301:0:10348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4912784780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874699552373120:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787853132.010424:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787853132.010435:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4908ca4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874699552373248:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787853132.010464:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853132.010511:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552373248 00000100:00100000:0.0:1787853132.010515:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552373248 00000100:00100000:0.0:1787853132.010537:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787853132.010543:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4908ca61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874699552373248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787853132.010602:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787853132.010649:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4908ca61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874699552373248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853132.010656:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787853132.010705:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4908ca4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874699552373248:0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787853132.011640:0:10348:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787853132.011701:0:10348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4912784780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874699552373120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1400us (1529us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853132.011710:0:10348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787853132.012895:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4908ca4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874699552373120:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787853132.013754:0:5823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4912784b40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5823:1874699552372992:192.168.204.1@tcp:105: 00010000:00010000:2.0:1787853132.013775:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787853132.013839:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493fdd7c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+6:2362:x1874699526146048:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 8191us (9219us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853132.013850:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 61 00000100:00100000:1.0:1787853132.020523:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853132.020680:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526146304 00000100:00100000:0.0:1787853132.020691:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526146304 00000100:00100000:0.0:1787853132.020767:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 36 00000100:00100000:0.0:1787853132.020778:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f48039f2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+17:11368:x1874699526146304:12345-192.168.204.1@tcp:35:bash.0 00000100:00100000:0.0:1787853132.021151:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f48039f2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+18:11368:x1874699526146304:12345-192.168.204.1@tcp:35:bash.0 Request processed in 374us (640us total) trans 4294967418 rc 0/0 00000100:00100000:0.0:1787853132.021162:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 36 00000100:00100000:3.0:1787853132.179665:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853132.179786:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526146560 00000100:00100000:0.0:1787853132.179815:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526146560 00000100:00100000:0.0:1787853132.179890:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 144 00000100:00100000:0.0:1787853132.179901:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493fdd4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+18:11379:x1874699526146560:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:0.0:1787853132.179941:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853132.179965:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7400/0x710df789068e6b7e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c5079389856 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787853132.180093:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1787853132.180217:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7400/0x710df789068e6b7e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389856 expref: 20 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853132.180234:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f4914d11200) 00010000:00010000:0.0:1787853132.180237:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787853132.180243:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7400/0x710df789068e6b7e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389856 expref: 20 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853132.180262:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49415b7400, rc 0) 00000100:00100000:0.0:1787853132.180342:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493fdd4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+19:11379:x1874699526146560:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 443us (688us total) trans 4294967419 rc 301/301 00000100:00100000:0.0:1787853132.180350:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 144 00000100:00100000:1.0:1787853132.187712:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853132.187837:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526146816 00000100:00100000:0.0:1787853132.187848:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526146816 00000100:00100000:0.0:1787853132.187922:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 37 00000100:00100000:0.0:1787853132.187933:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4934117840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+19:11379:x1874699526146816:12345-192.168.204.1@tcp:35:lfs.0 00000100:00100000:0.0:1787853132.188220:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4934117840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+20:11379:x1874699526146816:12345-192.168.204.1@tcp:35:lfs.0 Request processed in 289us (519us total) trans 4294967420 rc 0/0 00000100:00100000:0.0:1787853132.188228:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 37 00000100:00100000:3.0:1787853132.304703:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853132.304811:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526146944 00000100:00100000:0.0:1787853132.304821:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526146944 00000100:00100000:0.0:1787853132.304887:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 145 00000100:00100000:0.0:1787853132.304898:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493fdd52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+20:11385:x1874699526146944:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:0.0:1787853132.304935:0:8462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853132.304957:0:8462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7400/0x710df789068e6b8c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c507938985d expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853132.305032:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e6b93 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853132.305046:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e6b93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853132.305058:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e6b93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787853132.305127:0:8462:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:0.0:1787853132.305131:0:8462:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787853132.305155:0:8462:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e6b93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853132.305184:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7400/0x710df789068e6b8c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c507938985d expref: 22 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853132.305205:0:8462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e6b93 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c507938985d expref: 21 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853132.305214:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8f4910f92100) 00010000:00010000:0.0:1787853132.305217:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787853132.305238:0:8462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49415b6200, rc 0) 00000100:00100000:0.0:1787853132.305313:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493fdd52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+21:11385:x1874699526146944:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 416us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853132.305780:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 145 00000100:00100000:1.0:1787853132.308887:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853132.309319:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526147200 00000100:00100000:0.0:1787853132.309331:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526147200 00000100:00100000:0.0:1787853132.309401:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 146 00000100:00100000:0.0:1787853132.309410:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4934116940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+21:11385:x1874699526147200:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:0.0:1787853132.309429:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853132.309451:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6600/0x710df789068e6b9a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c5079389864 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853132.309551:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6400/0x710df789068e6ba1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853132.309566:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6400/0x710df789068e6ba1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853132.309608:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6400/0x710df789068e6ba1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787853132.309619:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1787853132.309758:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6600/0x710df789068e6b9a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389864 expref: 24 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853132.309779:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6400/0x710df789068e6ba1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389864 expref: 23 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853132.309787:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f4914d11800) 00010000:00010000:0.0:1787853132.309804:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787853132.309808:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49415b6400, rc 0) 00000100:00100000:0.0:1787853132.309870:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4934116940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+23:11385:x1874699526147200:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 461us (994us total) trans 4294967421 rc 0/0 00000100:00100000:0.0:1787853132.309877:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 146 00000100:00100000:3.0:1787853132.313635:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853132.313762:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526147328 00000100:00100000:1.0:1787853132.313771:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526147328 00000100:00100000:1.0:1787853132.313844:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 10 00000100:00100000:1.0:1787853132.313854:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493fdd4f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+23:2364:x1874699526147328:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787853132.313870:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787853132.313895:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6400/0x710df789068e6ba1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389864 expref: 23 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853132.313932:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f4914d11800) 00010000:00010000:1.0:1787853132.313938:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787853132.314000:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493fdd4f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+22:2364:x1874699526147328:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 147us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853132.314008:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 10 00000100:00100000:3.0:1787853132.317288:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853132.320425:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526147584 00000100:00100000:0.0:1787853132.320441:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526147584 00000100:00100000:0.0:1787853132.320599:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 147 00000100:00100000:0.0:1787853132.320613:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493fdd5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+22:11385:x1874699526147584:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:0.0:1787853132.320644:0:8462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853132.320671:0:8462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7600/0x710df789068e6baf lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c507938986b expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853132.320794:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6a00/0x710df789068e6bb6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853132.320812:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6a00/0x710df789068e6bb6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853132.320825:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6a00/0x710df789068e6bb6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787853132.320838:0:8462:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1787853132.324372:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7600/0x710df789068e6baf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c507938986b expref: 25 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853132.324405:0:8462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6a00/0x710df789068e6bb6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c507938986b expref: 24 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853132.324440:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f4914d11800) 00010000:00010000:0.0:1787853132.324444:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787853132.324448:0:8462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49415b6a00, rc 0) 00000100:00100000:0.0:1787853132.324536:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493fdd5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+24:11385:x1874699526147584:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 3926us (7257us total) trans 4294967422 rc 0/0 00000100:00100000:0.0:1787853132.324546:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 147 00000100:00100000:1.0:1787853132.351006:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853132.354015:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526147712 00000100:00100000:0.0:1787853132.354035:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526147712 00000100:00100000:0.0:1787853132.354174:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 51 00000100:00100000:0.0:1787853132.354188:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4934116580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+6:2363:x1874699526147712:12345-192.168.204.1@tcp:1:lfs.0 00010000:00010000:0.0:1787853132.354236:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084c01721/0x710df789068e6bc4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853132.354260:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003e07b8dd/0x710df789068e6b77 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.1@tcp remote: 0xd0a9c507938984f expref: 6 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853132.354271:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787853132.354276:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787853132.354281:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000084c01721/0x710df789068e6bc4 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853132.354332:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003e07b8dd/0x710df789068e6b77 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.1@tcp remote: 0xd0a9c507938984f expref: 6 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853132.354348:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003e07b8dd/0x710df789068e6b77 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.1@tcp remote: 0xd0a9c507938984f expref: 6 pid: 8463 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853132.354382:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4908ca4b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6682:1874699552373376:192.168.204.1@tcp:104: 00000100:00100000:0.0:1787853132.354502:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f49419c4600 going to sleep for 11 seconds 00000100:00100000:0.0:1787853132.360347:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4908ca4b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6682:1874699552373376:192.168.204.1@tcp:104: 00010000:00010000:0.0:1787853132.360389:0:6682:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000084c01721/0x710df789068e6bc4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853132.361453:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853132.361531:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526147840 00000100:00100000:2.0:1787853132.361539:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526147840 00002000:00100000:2.0:1787853132.361626:0:6689:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff8f49341152c0 x1874699526147840/t0(0) o4->b1d98f5a-0be0-4f69-83a6-833c935c8205@192.168.204.1@tcp:308/0 lens 504/0 e 0 to 0 dl 1787853143 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787853132.361639:0:6689:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff8f49341152c0 with x1874699526147840 ext(0->12) 00010000:00010000:2.0:1787853132.361647:0:6689:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003e07b8dd/0x710df789068e6b77 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.1@tcp remote: 0xd0a9c507938984f expref: 7 pid: 8463 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853132.361666:0:6689:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003e07b8dd/0x710df789068e6b77 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.1@tcp remote: 0xd0a9c507938984f expref: 7 pid: 8463 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787853132.361674:0:6689:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8f49341152c0 00000100:00100000:2.0:1787853132.361721:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 2 00000100:00100000:2.0:1787853132.361732:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49341152c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+7:2362:x1874699526147840:12345-192.168.204.1@tcp:4:lfs.0 00000100:00100000:2.0:1787853132.365730:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49341152c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+9:2362:x1874699526147840:12345-192.168.204.1@tcp:4:lfs.0 Request processed in 3978us (4270us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1787853132.365759:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 2 00002000:00100000:2.0:1787853132.365773:0:6689:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff8f49341152c0 x1874699526147840/t4294967305(0) o4->b1d98f5a-0be0-4f69-83a6-833c935c8205@192.168.204.1@tcp:308/0 lens 504/448 e 0 to 0 dl 1787853143 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787853132.365784:0:6689:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff8f49341152c0 with x1874699526147840 ext(0->12) 00010000:00010000:2.0:1787853132.365795:0:6689:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003e07b8dd/0x710df789068e6b77 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.1@tcp remote: 0xd0a9c507938984f expref: 9 pid: 8463 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853132.365817:0:6689:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003e07b8dd/0x710df789068e6b77 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.1@tcp remote: 0xd0a9c507938984f expref: 9 pid: 8463 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787853132.365826:0:6689:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8f49341152c0 00000100:00100000:3.0:1787853132.371943:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853132.373530:0:11175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526147968 00000100:00100000:1.0:1787853132.373542:0:11175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526147968 00010000:00010000:1.0:1787853132.373643:0:11175:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003e07b8dd/0x710df789068e6b77 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.1@tcp remote: 0xd0a9c507938984f expref: 9 pid: 8463 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853132.373702:0:11175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 62 00000100:00100000:1.0:1787853132.373724:0:11175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493fdd4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b1d98f5a-0be0-4f69-83a6-833c935c8205+9:2363:x1874699526147968:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787853132.373743:0:11175:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1787853132.373765:0:11175:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1787853132.373768:0:11175:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787853132 00002000:00010000:1.0:1787853132.373770:0:11175:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787853132 00002000:00010000:1.0:1787853132.373772:0:11175:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1787853132 00010000:00010000:1.0:1787853132.373779:0:11175:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003e07b8dd/0x710df789068e6b77 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.1@tcp remote: 0xd0a9c507938984f expref: 9 pid: 8463 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853132.373793:0:11175:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003e07b8dd/0x710df789068e6b77 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.1@tcp remote: 0xd0a9c507938984f expref: 9 pid: 8463 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853132.373819:0:11175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003e07b8dd/0x710df789068e6b77 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.1@tcp remote: 0xd0a9c507938984f expref: 9 pid: 8463 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853132.373851:0:11175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787853132.373855:0:11175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787853132.373861:0:11175:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000084c01721/0x710df789068e6bc4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853132.373895:0:11175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000084c01721/0x710df789068e6bc4 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853132.373919:0:11175:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787853132.374002:0:11175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493fdd4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b1d98f5a-0be0-4f69-83a6-833c935c8205+8:2363:x1874699526147968:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 290us (2069us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853132.374019:0:11175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 62 00010000:00010000:0.0:1787853132.374114:0:6682:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000084c01721/0x710df789068e6bc4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853132.374124:0:6682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000084c01721/0x710df789068e6bc4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853132.374153:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084c01721/0x710df789068e6bc4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853132.374162:0:6682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000084c01721/0x710df789068e6bc4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853132.374170:0:6682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000084c01721/0x710df789068e6bc4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853132.374177:0:6682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b7600 already unused, calling callback (ffffffffc1528440) 00010000:00010000:0.0:1787853132.374182:0:6682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000084c01721/0x710df789068e6bc4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853132.374205:0:6682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000084c01721/0x710df789068e6bc4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853132.374217:0:6682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000084c01721/0x710df789068e6bc4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853132.374224:0:6682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000084c01721/0x710df789068e6bc4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853132.374272:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4934116580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+7:2363:x1874699526147712:12345-192.168.204.1@tcp:1:lfs.0 Request processed in 20088us (23277us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853132.374279:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 51 00000100:00100000:3.0:1787853132.379366:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853132.379464:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526148224 00000100:00100000:0.0:1787853132.379475:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526148224 00000100:00100000:0.0:1787853132.379538:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 38 00000100:00100000:0.0:1787853132.379548:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f491040a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+24:11385:x1874699526148224:12345-192.168.204.1@tcp:35:lfs.0 00000004:00010000:0.0:1787853132.379667:0:5840:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6a00/0x710df789068e6bb6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c507938986b expref: 24 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787853132.379949:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:0.0:1787853132.379993:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:0.0:1787853132.380512:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:0.0:1787853132.380565:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6600/0x710df789068e6bcb lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853132.380607:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad000/0x710df789068e6b62 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389841 expref: 28 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853132.380625:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6600/0x710df789068e6bcb lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853132.380657:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad000/0x710df789068e6b62 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389841 expref: 28 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853132.380673:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad000/0x710df789068e6b62 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389841 expref: 28 pid: 5836 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853132.380688:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4908ca4b40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5840:1874699552373504:192.168.204.1@tcp:104: 00000100:00100000:0.0:1787853132.380789:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f49419c4cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787853132.386098:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4908ca4b40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5840:1874699552373504:192.168.204.1@tcp:104: 00010000:00010000:0.0:1787853132.386137:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6600/0x710df789068e6bcb lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853132.390061:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853132.390242:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526148352 00000100:00100000:2.0:1787853132.390253:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526148352 00010000:00010000:2.0:1787853132.390297:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad000/0x710df789068e6b62 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389841 expref: 29 pid: 5836 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853132.390339:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 63 00000100:00100000:2.0:1787853132.390349:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493fdd4b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+29:2363:x1874699526148352:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787853132.390364:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787853132.390371:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad000/0x710df789068e6b62 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389841 expref: 29 pid: 5836 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853132.390384:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad000/0x710df789068e6b62 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389841 expref: 29 pid: 5836 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853132.390407:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad000/0x710df789068e6b62 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389841 expref: 29 pid: 5836 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853132.390443:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f4914d11800) 00010000:00010000:2.0:1787853132.390450:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6600/0x710df789068e6bcb lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853132.390459:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6600/0x710df789068e6bcb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853132.390467:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6600/0x710df789068e6bcb lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853132.390498:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787853132.390555:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493fdd4b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+28:2363:x1874699526148352:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 206us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853132.390562:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 63 00010000:00010000:0.0:1787853132.390765:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6600/0x710df789068e6bcb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853132.390774:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6600/0x710df789068e6bcb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787853132.390925:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:0.0:1787853132.391140:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:0.0:1787853132.391246:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4908ca4b40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5840:1874699552373632:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787853132.391297:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853132.391336:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f49419c4240 going to sleep for 11 seconds 00000100:00100000:2.0:1787853132.391648:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552373632 00000100:00100000:2.0:1787853132.391656:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552373632 00000100:00100000:2.0:1787853132.391702:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787853132.391720:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4908ca7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5840:x1874699552373632:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787853132.391794:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4908ca7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5840:x1874699552373632:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 85us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853132.391800:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787853132.392565:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4908ca4b40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5840:1874699552373632:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1787853132.393208:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:0.0:1787853132.393291:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4908ca4b40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5840:1874699552373760:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787853132.393472:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853132.393548:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f49419c4cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787853132.401491:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552373760 00000100:00100000:2.0:1787853132.401509:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552373760 00000100:00100000:2.0:1787853132.401603:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787853132.401613:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4908ca43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5840:x1874699552373760:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787853132.402417:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4908ca43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5840:x1874699552373760:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 802us (8941us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1787853132.402449:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787853132.405301:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4908ca4b40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5840:1874699552373760:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1787853132.405492:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:0.0:1787853132.405559:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6600/0x710df789068e6bcb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853132.405919:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6600/0x710df789068e6bcb lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853132.405929:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6600/0x710df789068e6bcb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853132.405936:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b6600 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:0.0:1787853132.405941:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6600/0x710df789068e6bcb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853132.405950:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6600/0x710df789068e6bcb lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853132.405969:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f4914d11800) 00010000:00010000:0.0:1787853132.405972:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1787853132.405976:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6600/0x710df789068e6bcb lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853132.405983:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6600/0x710df789068e6bcb lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787853132.407049:0:5840:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1787853132.407162:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:0.0:1787853132.407176:0:5840:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 451948604894ns, next at 452948601325ns, rc = 0 00000001:00080000:0.0:1787853132.407185:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:0.0:1787853132.407233:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f4914d11800) 00010000:00010000:0.0:1787853132.407236:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787853132.407246:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6a00/0x710df789068e6bb6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c507938986b expref: 32 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853132.408266:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f491040a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+31:11385:x1874699526148224:12345-192.168.204.1@tcp:35:lfs.0 Request processed in 28713us (28907us total) trans 4294967431 rc 0/0 00000100:00100000:0.0:1787853132.408279:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 38 00000020:00080000:0.0:1787853132.408286:0:5840:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1787853132.413998:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853132.414085:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526148480 00000100:00100000:0.0:1787853132.414096:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526148480 00000100:00100000:0.0:1787853132.414163:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 148 00000100:00100000:0.0:1787853132.414173:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493fdd61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+31:11385:x1874699526148480:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:0.0:1787853132.414206:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853132.414236:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7600/0x710df789068e6bd2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c5079389872 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853132.414303:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7600/0x710df789068e6bd2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389872 expref: 32 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853132.414330:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7600/0x710df789068e6bd2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389872 expref: 32 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853132.414350:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f491176b700) 00010000:00010000:0.0:1787853132.414353:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787853132.414375:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49415b7600, rc 0) 00000100:00100000:0.0:1787853132.414438:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493fdd61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+32:11385:x1874699526148480:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 267us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853132.414446:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 148 00000100:00100000:3.0:1787853132.431697:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853132.435969:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526148736 00000100:00100000:0.0:1787853132.435985:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526148736 00000100:00100000:1.0:1787853132.436131:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 39 00000100:00100000:1.0:1787853132.436143:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493fdd7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+32:11385:x1874699526148736:12345-192.168.204.1@tcp:35:lfs.0 00000100:00100000:1.0:1787853132.436435:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493fdd7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+33:11385:x1874699526148736:12345-192.168.204.1@tcp:35:lfs.0 Request processed in 294us (4747us total) trans 4294967432 rc 0/0 00000100:00100000:1.0:1787853132.436443:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 39 00010000:00010000:3.0:1787853132.585776:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787853132.642114:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853132.649500:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526148992 00000100:00100000:1.0:1787853132.649515:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526148992 00000100:00100000:1.0:1787853132.649621:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 149 00000100:00100000:1.0:1787853132.649632:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493fdd43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+33:11395:x1874699526148992:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:1.0:1787853132.649660:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853132.649681:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ada00/0x710df789068e6bd9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c5079389879 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787853132.649814:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1787853132.649929:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ada00/0x710df789068e6bd9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389879 expref: 35 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853132.649944:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f4914d11200) 00010000:00010000:1.0:1787853132.649962:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787853132.649968:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ada00/0x710df789068e6bd9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389879 expref: 35 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853132.649983:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f492a8ada00, rc 0) 00000100:00100000:1.0:1787853132.650052:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493fdd43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+34:11395:x1874699526148992:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 423us (8756us total) trans 4294967433 rc 301/301 00000100:00100000:1.0:1787853132.650061:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 149 00000100:00100000:3.0:1787853132.656866:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853132.657852:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526149120 00000100:00100000:0.0:1787853132.657865:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526149120 00000100:00100000:0.0:1787853132.657943:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 150 00000100:00100000:0.0:1787853132.657954:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493fdd70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+34:11395:x1874699526149120:12345-192.168.204.1@tcp:34:lfs.0 00010000:00010000:0.0:1787853132.658039:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6a00/0x710df789068e6be7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853132.658057:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6a00/0x710df789068e6be7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853132.658079:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6a00/0x710df789068e6be7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853132.658095:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6600/0x710df789068e6bee lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853132.658103:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6600/0x710df789068e6bee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853132.658109:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6600/0x710df789068e6bee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853132.658216:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6e00/0x710df789068e6bf5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853132.658224:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6e00/0x710df789068e6bf5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853132.658246:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6e00/0x710df789068e6bf5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787853132.658291:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6e00/0x710df789068e6bf5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853132.658305:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6a00/0x710df789068e6be7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853132.658448:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6a00/0x710df789068e6be7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853132.658455:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6a00/0x710df789068e6be7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853132.658462:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b6a00 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:0.0:1787853132.658466:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6a00/0x710df789068e6be7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853132.658475:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6a00/0x710df789068e6be7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853132.658489:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8f4910f92100) 00010000:00010000:0.0:1787853132.658493:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787853132.658497:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6a00/0x710df789068e6be7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853132.658503:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6a00/0x710df789068e6be7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853132.658522:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6600/0x710df789068e6bee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853132.658535:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6600/0x710df789068e6bee lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853132.658541:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6600/0x710df789068e6bee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853132.658547:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b6600 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:0.0:1787853132.658551:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6600/0x710df789068e6bee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853132.658558:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6600/0x710df789068e6bee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853132.658634:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8f491176b900) 00010000:00010000:0.0:1787853132.658639:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787853132.658642:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6600/0x710df789068e6bee lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853132.658649:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6600/0x710df789068e6bee lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853132.658665:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6e00/0x710df789068e6bf5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853132.658672:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6e00/0x710df789068e6bf5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853132.658678:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6e00/0x710df789068e6bf5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853132.658683:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b6e00 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:0.0:1787853132.658692:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6e00/0x710df789068e6bf5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853132.658699:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6e00/0x710df789068e6bf5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853132.658722:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f491176b700) 00010000:00010000:0.0:1787853132.658725:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787853132.658728:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6e00/0x710df789068e6bf5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853132.658735:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6e00/0x710df789068e6bf5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853132.658823:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493fdd70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+34:11395:x1874699526149120:12345-192.168.204.1@tcp:34:lfs.0 Request processed in 869us (1966us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853132.658833:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 150 00000100:00100000:3.0:1787853132.663766:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853132.663851:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526149376 00000100:00100000:1.0:1787853132.663861:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526149376 00000100:00100000:1.0:1787853132.663913:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 40 00000100:00100000:1.0:1787853132.663923:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493fdd5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+34:11395:x1874699526149376:12345-192.168.204.1@tcp:35:lfs.0 00000100:00100000:1.0:1787853132.664212:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493fdd5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+35:11395:x1874699526149376:12345-192.168.204.1@tcp:35:lfs.0 Request processed in 290us (456us total) trans 4294967434 rc 0/0 00000100:00100000:1.0:1787853132.664219:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 40 00000100:00100000:3.0:1787853132.773828:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853132.773947:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526149632 00000100:00100000:0.0:1787853132.773957:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526149632 00000100:00100000:0.0:1787853132.774018:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 151 00000100:00100000:0.0:1787853132.774027:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493fdd6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+35:11398:x1874699526149632:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:0.0:1787853132.774050:0:8462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853132.774081:0:8462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6e00/0x710df789068e6bfc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c5079389880 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853132.774169:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6600/0x710df789068e6c03 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853132.774183:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6600/0x710df789068e6c03 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853132.774218:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6600/0x710df789068e6c03 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853132.774233:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6a00/0x710df789068e6c0a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853132.774239:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6a00/0x710df789068e6c0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853132.774245:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6a00/0x710df789068e6c0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853132.774380:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6800/0x710df789068e6c11 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853132.774389:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6800/0x710df789068e6c11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853132.774396:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6800/0x710df789068e6c11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787853132.774406:0:8462:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1787853132.774840:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6600/0x710df789068e6c03 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853132.774849:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6600/0x710df789068e6c03 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853132.774856:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6600/0x710df789068e6c03 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853132.774863:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b6600 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:0.0:1787853132.774874:0:8462:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6600/0x710df789068e6c03 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853132.774882:0:8462:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6600/0x710df789068e6c03 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853132.774894:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8f4910f92100) 00010000:00010000:0.0:1787853132.774897:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787853132.774901:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6600/0x710df789068e6c03 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853132.774907:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6600/0x710df789068e6c03 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853132.774924:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6a00/0x710df789068e6c0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853132.774930:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6a00/0x710df789068e6c0a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853132.774936:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6a00/0x710df789068e6c0a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853132.774942:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b6a00 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:0.0:1787853132.774945:0:8462:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6a00/0x710df789068e6c0a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853132.774951:0:8462:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6a00/0x710df789068e6c0a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853132.774958:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8f491176b900) 00010000:00010000:0.0:1787853132.774960:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787853132.774970:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6a00/0x710df789068e6c0a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853132.774976:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6a00/0x710df789068e6c0a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853132.775020:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6e00/0x710df789068e6bfc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389880 expref: 38 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853132.775035:0:8462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6800/0x710df789068e6c11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389880 expref: 37 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853132.775042:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f491176b700) 00010000:00010000:0.0:1787853132.775045:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787853132.775047:0:8462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49415b6800, rc 0) 00000100:00100000:0.0:1787853132.775736:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493fdd6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+37:11398:x1874699526149632:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 1707us (1915us total) trans 4294967435 rc 0/0 00000100:00100000:0.0:1787853132.775745:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 151 00000100:00100000:0.0:1787853132.784856:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853132.784959:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526149760 00000100:00100000:3.0:1787853132.784969:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526149760 00000100:00100000:3.0:1787853132.785031:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 152 00000100:00100000:3.0:1787853132.785042:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4908ca4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+37:11398:x1874699526149760:12345-192.168.204.1@tcp:54:lfs.0 00010000:00010000:3.0:1787853132.785319:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e6c1f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853132.785338:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e6c1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853132.785352:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e6c1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853132.785382:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e6c1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853132.785390:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e6c1f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853132.785397:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e6c1f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853132.785404:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4921e20c00 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:3.0:1787853132.785409:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e6c1f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853132.785485:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e6c1f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853132.785522:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f491176b700) 00010000:00010000:3.0:1787853132.785525:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787853132.785531:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e6c1f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853132.785537:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e6c1f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853132.785906:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4908ca4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+37:11398:x1874699526149760:12345-192.168.204.1@tcp:54:lfs.0 Request processed in 864us (1060us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853132.785914:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 152 00000100:00100000:0.0:1787853132.791323:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853132.791433:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526150016 00000100:00100000:1.0:1787853132.791445:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526150016 00000100:00100000:1.0:1787853132.791508:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 41 00000100:00100000:1.0:1787853132.791520:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4908ca5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+37:11398:x1874699526150016:12345-192.168.204.1@tcp:35:lfs.0 00000100:00100000:1.0:1787853132.791826:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4908ca5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+38:11398:x1874699526150016:12345-192.168.204.1@tcp:35:lfs.0 Request processed in 309us (521us total) trans 4294967436 rc 0/0 00000100:00100000:1.0:1787853132.791834:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 41 00000100:00100000:0.0:1787853133.227516:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853133.227625:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526150272 00000100:00100000:2.0:1787853133.227635:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526150272 00000100:00080000:3.0:1787853133.227718:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787853133.227734:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 153 00000100:00100000:2.0:1787853133.227746:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4910d243c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+38:11429:x1874699526150272:12345-192.168.204.1@tcp:101:cat.0 00010000:00010000:2.0:1787853133.227772:0:8462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853133.227794:0:8462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9e00/0x710df789068e6c26 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c5079389887 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853133.227906:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8800/0x710df789068e6c2d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853133.227921:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8800/0x710df789068e6c2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853133.227935:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8800/0x710df789068e6c2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787853133.227947:0:8462:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1787853133.228071:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9e00/0x710df789068e6c26 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389887 expref: 41 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853133.228090:0:8462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8800/0x710df789068e6c2d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389887 expref: 40 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853133.228099:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f491176b700) 00010000:00010000:2.0:1787853133.228101:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787853133.228104:0:8462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49415b8800, rc 0) 00000100:00100000:2.0:1787853133.228179:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4910d243c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+40:11429:x1874699526150272:12345-192.168.204.1@tcp:101:cat.0 Request processed in 436us (673us total) trans 4294967437 rc 0/0 00000100:00100000:2.0:1787853133.228186:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 153 00000100:00100000:3.0:1787853133.234645:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853133.235100:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526150528 00000100:00100000:1.0:1787853133.235111:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526150528 00000100:00100000:1.0:1787853133.235177:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 42 00000100:00100000:1.0:1787853133.235187:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493fdd6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+40:11429:x1874699526150528:12345-192.168.204.1@tcp:35:cat.0 00000100:00100000:1.0:1787853133.235481:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493fdd6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+41:11429:x1874699526150528:12345-192.168.204.1@tcp:35:cat.0 Request processed in 295us (845us total) trans 4294967438 rc 0/0 00000100:00100000:1.0:1787853133.235489:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 42 00000100:00100000:0.0:1787853133.240004:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853133.240513:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526150656 00000100:00100000:3.0:1787853133.240523:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526150656 00000100:00100000:3.0:1787853133.240639:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 11 00000100:00100000:3.0:1787853133.240649:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4910d25680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+41:2363:x1874699526150656:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787853133.240675:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787853133.240714:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8800/0x710df789068e6c2d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389887 expref: 41 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853133.240738:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f491176b700) 00010000:00010000:3.0:1787853133.240744:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787853133.241255:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4910d25680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+40:2363:x1874699526150656:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 606us (1262us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853133.241264:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 11 00000100:00100000:3.0:1787853133.289746:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853133.290118:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526150912 00000100:00100000:1.0:1787853133.290129:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526150912 00000100:00100000:1.0:1787853133.290331:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 154 00000100:00100000:1.0:1787853133.290343:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493c58fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+40:11435:x1874699526150912:12345-192.168.204.1@tcp:101:dd.0 00010000:00010000:1.0:1787853133.290366:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853133.290369:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787853133.290396:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e6b93 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c507938985d expref: 40 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853133.290418:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8f4910f92100) 00010000:00010000:1.0:1787853133.290424:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787853133.290437:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ada00/0x710df789068e6c3b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c507938988e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853133.290535:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e6c42 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853133.290547:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6800/0x710df789068e6c11 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389880 expref: 40 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853133.290557:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e6c42 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853133.290654:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6800/0x710df789068e6c11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389880 expref: 40 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853133.290682:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6800/0x710df789068e6c11 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389880 expref: 40 pid: 8462 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853133.290707:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4934114f00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5838:1874699552373888:192.168.204.1@tcp:104: 00000100:00100000:0.0:1787853133.291114:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f4912b47240 going to sleep for 11 seconds 00000100:00100000:3.0:1787853133.292908:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4934114f00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5838:1874699552373888:192.168.204.1@tcp:104: 00010000:00010000:3.0:1787853133.292934:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e6c42 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853133.293083:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853133.293187:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526151040 00000100:00100000:2.0:1787853133.293193:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526151040 00010000:00010000:2.0:1787853133.293227:0:8450:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6800/0x710df789068e6c11 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389880 expref: 41 pid: 8462 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853133.293462:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 64 00000100:00100000:2.0:1787853133.293473:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4905687850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+41:2362:x1874699526151040:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787853133.293489:0:8450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787853133.293496:0:8450:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6800/0x710df789068e6c11 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389880 expref: 41 pid: 8462 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853133.293509:0:8450:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6800/0x710df789068e6c11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389880 expref: 41 pid: 8462 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853133.293530:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6800/0x710df789068e6c11 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389880 expref: 41 pid: 8462 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853133.293546:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f491176b700) 00010000:00010000:2.0:1787853133.293551:0:8450:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e6c42 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853133.293560:0:8450:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e6c42 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853133.293566:0:8450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e6c42 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853133.293675:0:8450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787853133.293737:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4905687850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+40:2362:x1874699526151040:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 266us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853133.293745:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 64 00010000:00010000:3.0:1787853133.293903:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e6c42 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853133.293911:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e6c42 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787853133.293928:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1787853133.294107:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ada00/0x710df789068e6c3b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c507938988e expref: 41 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853133.294121:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e6c42 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c507938988e expref: 40 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853133.294128:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f491176b700) 00010000:00010000:3.0:1787853133.294130:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787853133.294133:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f492a8ad200, rc 0) 00000100:00100000:3.0:1787853133.294204:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493c58fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+40:11435:x1874699526150912:12345-192.168.204.1@tcp:101:dd.0 Request processed in 3864us (4469us total) trans 4294967439 rc 0/0 00000100:00100000:3.0:1787853133.294212:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 154 00000100:00100000:0.0:1787853133.296992:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853133.297047:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526151296 00000100:00100000:2.0:1787853133.297056:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526151296 00000100:00100000:2.0:1787853133.297112:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 155 00000100:00100000:2.0:1787853133.297121:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4910d25680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+40:11435:x1874699526151296:12345-192.168.204.1@tcp:36:dd.0 00010000:00010000:2.0:1787853133.297356:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9e00/0x710df789068e6c50 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853133.297435:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9e00/0x710df789068e6c50 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853133.297447:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9e00/0x710df789068e6c50 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787853133.297493:0:8462:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:2.0:1787853133.297514:0:8462:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003f5e4f3c reply state 00000000addf22c1 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9e00/0x710df789068e6c50 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853133.297523:0:8462:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787853133.297640:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4910d25680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+43:11435:x1874699526151296:12345-192.168.204.1@tcp:36:dd.0 Request processed in 519us (655us total) trans 4294967441 rc 0/0 00000100:00100000:2.0:1787853133.297658:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 155 00000020:00080000:2.0:1787853133.297664:0:8462:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787853133.299021:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9e00/0x710df789068e6c50 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853133.299036:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9e00/0x710df789068e6c50 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853133.299055:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9e00/0x710df789068e6c50 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853133.299096:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b9e00 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:3.0:1787853133.299102:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9e00/0x710df789068e6c50 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853133.299120:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9e00/0x710df789068e6c50 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853133.299159:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f491176b700) 00010000:00010000:3.0:1787853133.299171:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787853133.299177:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9e00/0x710df789068e6c50 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853133.299184:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9e00/0x710df789068e6c50 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853133.600528:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853133.600804:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526151424 00000100:00100000:2.0:1787853133.600817:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526151424 00000100:00100000:2.0:1787853133.600891:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 156 00000100:00100000:2.0:1787853133.600912:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f48039f2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+42:11449:x1874699526151424:12345-192.168.204.1@tcp:101:stat.0 00010000:00010000:2.0:1787853133.600941:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853133.600966:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9e00/0x710df789068e6c57 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c5079389895 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853133.601054:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8800/0x710df789068e6c5e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853133.601073:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8800/0x710df789068e6c5e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853133.601091:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8800/0x710df789068e6c5e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853133.601109:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8200/0x710df789068e6c65 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853133.601115:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8200/0x710df789068e6c65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853133.601123:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8200/0x710df789068e6c65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853133.601243:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8000/0x710df789068e6c6c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853133.601256:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e6c42 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c507938988e expref: 43 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853133.601264:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8000/0x710df789068e6c6c lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853133.601310:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e6c42 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.1@tcp remote: 0xd0a9c507938988e expref: 43 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853133.601326:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e6c42 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c507938988e expref: 43 pid: 5838 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853133.601342:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4912784b40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5837:1874699552374016:192.168.204.1@tcp:104: 00000100:00100000:2.0:1787853133.601472:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f492a8a2600 going to sleep for 11 seconds 00010000:00010000:0.0:1787853133.618333:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787853133.621787:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853133.623715:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526151680 00000100:00100000:1.0:1787853133.623730:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526151680 00000100:00100000:1.0:1787853133.623797:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 43 00000100:00100000:1.0:1787853133.623807:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4912785e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+44:5606:x1874699526151680:12345-192.168.204.1@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787853133.624156:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4912785e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+45:5606:x1874699526151680:12345-192.168.204.1@tcp:35:ldlm_bl.0 Request processed in 350us (2381us total) trans 4294967442 rc 0/0 00000100:00100000:1.0:1787853133.624164:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 43 00000100:00100000:3.0:1787853133.625063:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4912784b40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5837:1874699552374016:192.168.204.1@tcp:104: 00010000:00010000:3.0:1787853133.625089:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8000/0x710df789068e6c6c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853133.640735:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853133.640942:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526151808 00000100:00100000:3.0:1787853133.640952:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526151808 00010000:00010000:3.0:1787853133.640996:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e6c42 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c507938988e expref: 45 pid: 5838 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853133.641037:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 65 00000100:00100000:3.0:1787853133.641047:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4934117480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+45:2362:x1874699526151808:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787853133.641063:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787853133.641069:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e6c42 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c507938988e expref: 45 pid: 5838 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853133.641099:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e6c42 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c507938988e expref: 45 pid: 5838 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853133.641133:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e6c42 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c507938988e expref: 45 pid: 5838 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853133.641152:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f491176b700) 00010000:00010000:3.0:1787853133.641158:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8000/0x710df789068e6c6c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853133.641168:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8000/0x710df789068e6c6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853133.641176:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8000/0x710df789068e6c6c lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853133.641214:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787853133.641276:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4934117480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+44:2362:x1874699526151808:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 231us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853133.641283:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 65 00010000:00010000:0.0:1787853133.643185:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8000/0x710df789068e6c6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853133.643230:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8000/0x710df789068e6c6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787853133.643287:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1787853133.643302:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787853133.643328:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8000/0x710df789068e6c6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853133.643345:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8000/0x710df789068e6c6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853133.643355:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8800/0x710df789068e6c5e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853133.643362:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8800/0x710df789068e6c5e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853133.643369:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8800/0x710df789068e6c5e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853133.643375:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b8800 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:0.0:1787853133.643379:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8800/0x710df789068e6c5e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853133.643387:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8800/0x710df789068e6c5e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853133.643410:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8f4910f92100) 00010000:00010000:0.0:1787853133.643413:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787853133.643418:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8800/0x710df789068e6c5e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853133.643434:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8800/0x710df789068e6c5e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853133.643454:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8200/0x710df789068e6c65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853133.643460:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8200/0x710df789068e6c65 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853133.643466:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8200/0x710df789068e6c65 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853133.643471:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b8200 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:0.0:1787853133.643474:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8200/0x710df789068e6c65 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853133.643480:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8200/0x710df789068e6c65 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853133.643488:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8f4910aaba00) 00010000:00010000:0.0:1787853133.643491:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787853133.643494:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8200/0x710df789068e6c65 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853133.643499:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8200/0x710df789068e6c65 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853133.643541:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9e00/0x710df789068e6c57 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389895 expref: 44 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853133.643555:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8000/0x710df789068e6c6c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389895 expref: 43 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853133.643607:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f491176b700) 00010000:00010000:0.0:1787853133.643610:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787853133.643612:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49415b8000, rc 0) 00000100:00100000:0.0:1787853133.643670:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f48039f2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+43:11449:x1874699526151424:12345-192.168.204.1@tcp:101:stat.0 Request processed in 42760us (43154us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853133.643678:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 156 00000001:00080000:3.0:1787853133.666136:0:7641:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000001:00080000:3.0:1787853133.666155:0:7641:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000100:00100000:2.0:1787853133.717996:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853133.718130:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526152064 00000100:00100000:1.0:1787853133.718144:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526152064 00000100:00100000:1.0:1787853133.718242:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 157 00000100:00100000:1.0:1787853133.718256:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4912787480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+43:11455:x1874699526152064:12345-192.168.204.1@tcp:36:truncate.0 00010000:00010000:1.0:1787853133.718358:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787853133.718454:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8000/0x710df789068e6c6c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389895 expref: 43 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853133.718484:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f491176b700) 00010000:00010000:1.0:1787853133.718490:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787853133.718916:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e6c73 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853133.718953:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e6c73 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853133.718970:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e6c73 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787853133.719045:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:1.0:1787853133.719072:0:5836:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000017a6f9ae reply state 00000000106d510e transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e6c73 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853133.719084:0:5836:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787853133.721160:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4912787480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+45:11455:x1874699526152064:12345-192.168.204.1@tcp:36:truncate.0 Request processed in 2887us (3163us total) trans 4294967444 rc 0/0 00000100:00100000:0.0:1787853133.721177:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 157 00000020:00080000:0.0:1787853133.721188:0:5836:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787853133.734722:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e6c73 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853133.734746:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e6c73 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853133.734755:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e6c73 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853133.734762:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f492a8ad200 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:0.0:1787853133.734767:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e6c73 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853133.734776:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e6c73 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853133.734799:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f491176b700) 00010000:00010000:0.0:1787853133.734803:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787853133.734837:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e6c73 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853133.734845:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e6c73 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853133.985922:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853133.986097:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526152192 00000100:00100000:3.0:1787853133.986111:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526152192 00000100:00100000:3.0:1787853133.986205:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 158 00000100:00100000:3.0:1787853133.986218:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4912786940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+44:11469:x1874699526152192:12345-192.168.204.1@tcp:101:stat.0 00010000:00010000:3.0:1787853133.986262:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853133.986312:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e6c7a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c507938989c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853133.986852:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20400/0x710df789068e6c81 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853133.986947:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20400/0x710df789068e6c81 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853133.986966:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20400/0x710df789068e6c81 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853133.986985:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e6c88 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853133.986993:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e6c88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853133.987000:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e6c88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853133.987149:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21a00/0x710df789068e6c8f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853133.987158:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21a00/0x710df789068e6c8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853133.987164:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21a00/0x710df789068e6c8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787853133.987216:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:3.0:1787853133.987222:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787853133.987253:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21a00/0x710df789068e6c8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853133.987277:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21a00/0x710df789068e6c8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853133.987287:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20400/0x710df789068e6c81 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853133.987295:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20400/0x710df789068e6c81 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853133.987302:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20400/0x710df789068e6c81 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853133.987309:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4921e20400 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:3.0:1787853133.987313:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20400/0x710df789068e6c81 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853133.987322:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20400/0x710df789068e6c81 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853133.987337:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8f4910f92100) 00010000:00010000:3.0:1787853133.987341:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787853133.987347:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20400/0x710df789068e6c81 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853133.987353:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20400/0x710df789068e6c81 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853133.987371:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e6c88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853133.987378:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e6c88 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853133.987391:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e6c88 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853133.987397:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4921e20000 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:3.0:1787853133.987400:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e6c88 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853133.987406:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e6c88 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853133.987415:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8f4910f92f00) 00010000:00010000:3.0:1787853133.987418:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787853133.987421:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e6c88 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853133.987427:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e6c88 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853133.989635:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e6c7a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c507938989c expref: 46 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853133.990845:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21a00/0x710df789068e6c8f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c507938989c expref: 45 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853133.990860:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f491176b700) 00010000:00010000:3.0:1787853133.991536:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787853133.991543:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4921e21a00, rc 0) 00000100:00100000:3.0:1787853133.992350:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4912786940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+45:11469:x1874699526152192:12345-192.168.204.1@tcp:101:stat.0 Request processed in 6125us (6436us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853133.992390:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 158 00000100:00100000:2.0:1787853134.154822:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853134.154885:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853134.154921:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853134.154962:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853134.155005:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526152576 00000100:00100000:2.0:1787853134.155018:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526152576 00000100:00100000:2.0:1787853134.155114:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526152448 00000100:00100000:2.0:1787853134.155118:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526152448 00000100:00100000:2.0:1787853134.155153:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 103 00000100:00100000:2.0:1787853134.155168:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4912786d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+5:2364:x1874699526152576:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:2.0:1787853134.155296:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4912786d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+5:2364:x1874699526152576:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 131us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853134.155305:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 103 00000100:00100000:2.0:1787853134.155330:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 104 00000100:00100000:2.0:1787853134.155338:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4912785680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+6:2364:x1874699526152448:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:2.0:1787853134.155389:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4912785680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+6:2364:x1874699526152448:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 52us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853134.155396:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 104 00000100:00080000:2.0:1787853134.155417:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787853134.155424:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787853134.155437:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526152704 00000100:00100000:2.0:1787853134.155441:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526152704 00000100:00100000:2.0:1787853134.155733:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 173 00000100:00100000:2.0:1787853134.155743:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4912786580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ea3b4e1-e827-460f-be07-19e86dff3d79+5:2364:x1874699526152704:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:2.0:1787853134.155779:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4912786580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ea3b4e1-e827-460f-be07-19e86dff3d79+5:2364:x1874699526152704:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 39us (817us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853134.155787:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 173 00000100:00080000:2.0:1787853134.155804:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787853134.157854:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526152320 00000100:00100000:3.0:1787853134.157879:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526152320 00000100:00100000:3.0:1787853134.157975:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 304 00000100:00100000:3.0:1787853134.157988:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4906230050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af755b38-4932-400a-92cc-ddad0ca077a5+13:2364:x1874699526152320:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:3.0:1787853134.158121:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4906230050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af755b38-4932-400a-92cc-ddad0ca077a5+13:2364:x1874699526152320:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 136us (3319us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853134.158138:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 304 00000100:00100000:2.0:1787853134.224808:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853134.225021:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526152960 00000100:00100000:0.0:1787853134.225042:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526152960 00000100:00100000:0.0:1787853134.225297:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 159 00000100:00100000:0.0:1787853134.225316:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4912784b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+45:11479:x1874699526152960:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:0.0:1787853134.225360:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853134.225405:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e6c96 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c50793898a3 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787853134.225714:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1787853134.225936:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e6c96 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793898a3 expref: 47 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853134.225961:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f4914d11200) 00010000:00010000:0.0:1787853134.225965:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787853134.225975:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e6c96 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793898a3 expref: 47 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853134.226006:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49415b7c00, rc 0) 00000100:00100000:0.0:1787853134.230884:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4912784b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+46:11479:x1874699526152960:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 5540us (6062us total) trans 4294967445 rc 301/301 00000100:00100000:0.0:1787853134.230907:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 159 00000100:00100000:1.0:1787853134.246848:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853134.253699:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526153216 00000100:00100000:3.0:1787853134.253730:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526153216 00000100:00100000:3.0:1787853134.253823:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 44 00000100:00100000:3.0:1787853134.253838:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4910409450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+46:11479:x1874699526153216:12345-192.168.204.1@tcp:35:lfs.0 00000100:00100000:3.0:1787853134.254281:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4910409450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+47:11479:x1874699526153216:12345-192.168.204.1@tcp:35:lfs.0 Request processed in 444us (7454us total) trans 4294967446 rc 0/0 00000100:00100000:3.0:1787853134.254293:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 44 00000100:00100000:2.0:1787853134.325781:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853134.325913:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526153472 00000100:00100000:0.0:1787853134.325929:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526153472 00000100:00100000:0.0:1787853134.326046:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 160 00000100:00100000:0.0:1787853134.326061:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4912785e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+47:11485:x1874699526153472:12345-192.168.204.1@tcp:101:bash.0 00010000:00010000:0.0:1787853134.326107:0:8462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853134.326139:0:8462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e6ca4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c50793898aa expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853134.326316:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7200/0x710df789068e6cab lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853134.326339:0:8462:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21a00/0x710df789068e6c8f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c507938989c expref: 48 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853134.326350:0:8462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7200/0x710df789068e6cab lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853134.326414:0:8462:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21a00/0x710df789068e6c8f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.1@tcp remote: 0xd0a9c507938989c expref: 48 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853134.326432:0:8462:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21a00/0x710df789068e6c8f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c507938989c expref: 48 pid: 5838 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853134.326449:0:8462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f493c5fed00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8462:1874699552374144:192.168.204.1@tcp:104: 00000100:00100000:0.0:1787853134.326739:0:8462:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f49419c49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787853134.330683:0:8462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f493c5fed00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8462:1874699552374144:192.168.204.1@tcp:104: 00010000:00010000:0.0:1787853134.330733:0:8462:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7200/0x710df789068e6cab lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853134.338009:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853134.338405:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526153600 00000100:00100000:3.0:1787853134.338421:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526153600 00010000:00010000:3.0:1787853134.338498:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21a00/0x710df789068e6c8f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c507938989c expref: 49 pid: 5838 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853134.338628:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 66 00000100:00100000:3.0:1787853134.338645:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493fdd7840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+49:2362:x1874699526153600:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787853134.338668:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787853134.338686:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21a00/0x710df789068e6c8f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c507938989c expref: 49 pid: 5838 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853134.338726:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21a00/0x710df789068e6c8f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c507938989c expref: 49 pid: 5838 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853134.338758:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21a00/0x710df789068e6c8f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c507938989c expref: 49 pid: 5838 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853134.338782:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f491176b700) 00010000:00010000:3.0:1787853134.338788:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7200/0x710df789068e6cab lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853134.338799:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7200/0x710df789068e6cab lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853134.338808:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7200/0x710df789068e6cab lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853134.338838:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787853134.338939:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493fdd7840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+48:2362:x1874699526153600:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 299us (946us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853134.338947:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 66 00010000:00010000:0.0:1787853134.340157:0:8462:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7200/0x710df789068e6cab lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853134.340189:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7200/0x710df789068e6cab lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787853134.340227:0:8462:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:0.0:1787853134.340512:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e6ca4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793898aa expref: 49 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853134.340539:0:8462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7200/0x710df789068e6cab lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793898aa expref: 48 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853134.340549:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f491176b700) 00010000:00010000:0.0:1787853134.340553:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787853134.340556:0:8462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49415b7200, rc 0) 00000100:00100000:0.0:1787853134.340719:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4912785e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+48:11485:x1874699526153472:12345-192.168.204.1@tcp:101:bash.0 Request processed in 14661us (14954us total) trans 4294967447 rc 0/0 00000100:00100000:0.0:1787853134.340731:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 160 00000100:00100000:2.0:1787853134.344430:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853134.344766:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526153856 00000100:00100000:3.0:1787853134.344782:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526153856 00000100:00100000:3.0:1787853134.344863:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 161 00000100:00100000:3.0:1787853134.344876:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493fdd5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+48:11485:x1874699526153856:12345-192.168.204.1@tcp:36:bash.0 00010000:00010000:3.0:1787853134.345294:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e6cb9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853134.345318:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e6cb9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853134.345351:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e6cb9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787853134.345437:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:3.0:1787853134.345467:0:5838:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000aa690aec reply state 0000000037e58126 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e6cb9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853134.345479:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787853134.346216:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493fdd5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+51:11485:x1874699526153856:12345-192.168.204.1@tcp:36:bash.0 Request processed in 1334us (1805us total) trans 4294967449 rc 0/0 00000100:00100000:3.0:1787853134.346226:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 161 00000020:00080000:3.0:1787853134.346234:0:5838:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787853134.353136:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e6cb9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853134.353164:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e6cb9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853134.353173:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e6cb9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853134.353181:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4921e20c00 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:2.0:1787853134.353188:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e6cb9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853134.353224:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e6cb9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853134.353256:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f491176b700) 00010000:00010000:2.0:1787853134.353260:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787853134.353267:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e6cb9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853134.353285:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e6cb9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853134.355504:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853134.355693:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526153984 00000100:00100000:0.0:1787853134.355707:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526153984 00000100:00100000:0.0:1787853134.355791:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 162 00000100:00100000:0.0:1787853134.355805:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493fdd6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+50:11485:x1874699526153984:12345-192.168.204.1@tcp:101:bash.0 00010000:00010000:0.0:1787853134.355837:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853134.355870:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e6cc0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c50793898b1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853134.356006:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7000/0x710df789068e6cc7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853134.356048:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7200/0x710df789068e6cab lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793898aa expref: 51 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853134.356060:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7000/0x710df789068e6cc7 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853134.356123:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7200/0x710df789068e6cab lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793898aa expref: 51 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853134.356141:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7200/0x710df789068e6cab lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793898aa expref: 51 pid: 8462 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853134.356159:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f493c5fed00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5836:1874699552374272:192.168.204.1@tcp:104: 00000100:00100000:0.0:1787853134.356545:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f49419c49c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787853134.368465:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853134.368749:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526154112 00000100:00100000:2.0:1787853134.368763:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526154112 00010000:00010000:2.0:1787853134.368824:0:8450:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7200/0x710df789068e6cab lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793898aa expref: 52 pid: 8462 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853134.368877:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 67 00000100:00100000:2.0:1787853134.368890:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493c58c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+52:2362:x1874699526154112:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787853134.368923:0:8450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787853134.368933:0:8450:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7200/0x710df789068e6cab lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793898aa expref: 52 pid: 8462 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853134.368950:0:8450:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7200/0x710df789068e6cab lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793898aa expref: 52 pid: 8462 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853134.368982:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f491176b700) 00010000:00010000:2.0:1787853134.368989:0:8450:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7000/0x710df789068e6cc7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853134.369016:0:8450:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7000/0x710df789068e6cc7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853134.369025:0:8450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7000/0x710df789068e6cc7 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853134.369051:0:8450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787853134.369152:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493c58c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+52:2362:x1874699526154112:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 264us (705us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853134.369160:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 67 00010000:00010000:0.0:1787853134.369396:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7200/0x710df789068e6cab lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793898aa expref: 51 pid: 8462 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853134.369417:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f493c5fed00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5836:1874699552374272:192.168.204.1@tcp:104: 00010000:00010000:0.0:1787853134.369450:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7000/0x710df789068e6cc7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853134.369462:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7000/0x710df789068e6cc7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853134.369468:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7000/0x710df789068e6cc7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787853134.369550:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1787853134.369565:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787853134.369659:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7000/0x710df789068e6cc7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853134.369717:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e6cc0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793898b1 expref: 51 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853134.369734:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7000/0x710df789068e6cc7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793898b1 expref: 50 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853134.369743:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f491176b700) 00010000:00010000:0.0:1787853134.369746:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787853134.369749:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49415b7000, rc 0) 00000100:00100000:0.0:1787853134.369785:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493fdd6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+50:11485:x1874699526153984:12345-192.168.204.1@tcp:101:bash.0 Request processed in 13985us (14303us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853134.369793:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 162 00000100:00100000:1.0:1787853134.375023:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853134.375862:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526154368 00000100:00100000:3.0:1787853134.375879:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526154368 00000100:00100000:3.0:1787853134.376016:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 45 00000100:00100000:3.0:1787853134.376031:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49341170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+50:11485:x1874699526154368:12345-192.168.204.1@tcp:35:bash.0 00000100:00100000:3.0:1787853134.376443:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49341170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+51:11485:x1874699526154368:12345-192.168.204.1@tcp:35:bash.0 Request processed in 414us (1439us total) trans 4294967450 rc 0/0 00000100:00100000:3.0:1787853134.376453:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 45 00000100:00100000:1.0:1787853134.527254:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853134.531777:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526154624 00000100:00100000:0.0:1787853134.531800:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526154624 00000100:00100000:1.0:1787853134.533591:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 163 00000100:00100000:1.0:1787853134.533609:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4934115a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+51:11495:x1874699526154624:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:1.0:1787853134.533648:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853134.533692:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad600/0x710df789068e6cce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c50793898b8 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787853134.533864:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1787853134.534738:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad600/0x710df789068e6cce lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793898b8 expref: 53 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853134.534762:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f4914d11200) 00010000:00010000:1.0:1787853134.534765:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787853134.534772:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad600/0x710df789068e6cce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793898b8 expref: 53 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853134.534813:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f492a8ad600, rc 0) 00000100:00100000:1.0:1787853134.535229:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4934115a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+52:11495:x1874699526154624:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 1622us (7992us total) trans 4294967451 rc 301/301 00000100:00100000:1.0:1787853134.535241:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 163 00000100:00100000:1.0:1787853134.540854:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853134.540924:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526154752 00000100:00100000:2.0:1787853134.540939:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526154752 00000100:00100000:0.0:1787853134.541212:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 164 00000100:00100000:0.0:1787853134.541232:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4934114f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+52:11495:x1874699526154752:12345-192.168.204.1@tcp:34:lfs.0 00010000:00010000:0.0:1787853134.541359:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e6cdc lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853134.541382:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e6cdc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853134.541404:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e6cdc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853134.541425:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7200/0x710df789068e6ce3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853134.541452:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7200/0x710df789068e6ce3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853134.541460:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7200/0x710df789068e6ce3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853134.541636:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7e00/0x710df789068e6cea lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853134.541646:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7e00/0x710df789068e6cea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853134.541654:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7e00/0x710df789068e6cea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787853134.541724:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7e00/0x710df789068e6cea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853134.541739:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e6cdc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853134.541747:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e6cdc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853134.541754:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e6cdc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853134.541761:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b7c00 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:0.0:1787853134.541765:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e6cdc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853134.541775:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e6cdc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853134.541799:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8f4910f92100) 00010000:00010000:0.0:1787853134.541803:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787853134.541810:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e6cdc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853134.541817:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e6cdc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853134.541837:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7200/0x710df789068e6ce3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853134.541843:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7200/0x710df789068e6ce3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853134.541850:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7200/0x710df789068e6ce3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853134.541856:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b7200 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:0.0:1787853134.541858:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7200/0x710df789068e6ce3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853134.541865:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7200/0x710df789068e6ce3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853134.541872:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8f491176bf00) 00010000:00010000:0.0:1787853134.541874:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787853134.541877:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7200/0x710df789068e6ce3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853134.541883:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7200/0x710df789068e6ce3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853134.542415:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7e00/0x710df789068e6cea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853134.542425:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7e00/0x710df789068e6cea lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853134.542431:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7e00/0x710df789068e6cea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853134.542437:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b7e00 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:0.0:1787853134.542441:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7e00/0x710df789068e6cea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853134.542448:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7e00/0x710df789068e6cea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853134.542459:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f491176b700) 00010000:00010000:0.0:1787853134.542461:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787853134.542465:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7e00/0x710df789068e6cea lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853134.542470:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7e00/0x710df789068e6cea lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853134.542610:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4934114f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+52:11495:x1874699526154752:12345-192.168.204.1@tcp:34:lfs.0 Request processed in 1380us (1769us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853134.542621:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 164 00000100:00100000:2.0:1787853134.545691:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853134.546043:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526155008 00000100:00100000:0.0:1787853134.546057:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526155008 00000100:00100000:3.0:1787853134.546207:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 46 00000100:00100000:3.0:1787853134.546222:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493fdd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+52:11495:x1874699526155008:12345-192.168.204.1@tcp:35:lfs.0 00000100:00100000:3.0:1787853134.546714:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493fdd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+53:11495:x1874699526155008:12345-192.168.204.1@tcp:35:lfs.0 Request processed in 495us (1047us total) trans 4294967452 rc 0/0 00000100:00100000:3.0:1787853134.546724:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 46 00000100:00100000:1.0:1787853134.632212:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853134.632334:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526155264 00000100:00100000:3.0:1787853134.632374:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526155264 00000100:00100000:3.0:1787853134.632470:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 165 00000100:00100000:3.0:1787853134.632483:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4934117840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+53:11498:x1874699526155264:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:3.0:1787853134.632521:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853134.632561:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21a00/0x710df789068e6cf1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c50793898bf expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853134.632715:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e6cf8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853134.632734:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e6cf8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853134.632749:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e6cf8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853134.632767:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20400/0x710df789068e6cff lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853134.632774:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20400/0x710df789068e6cff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853134.632780:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20400/0x710df789068e6cff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853134.632969:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21c00/0x710df789068e6d06 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853134.632979:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21c00/0x710df789068e6d06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853134.632988:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21c00/0x710df789068e6d06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787853134.633010:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1787853134.633147:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e6cf8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853134.633156:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e6cf8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853134.633164:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e6cf8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853134.633171:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4921e20000 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:3.0:1787853134.633177:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e6cf8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853134.633185:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e6cf8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853134.633200:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8f4910f92100) 00010000:00010000:3.0:1787853134.633203:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787853134.633208:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e6cf8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853134.633215:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e6cf8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853134.633232:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20400/0x710df789068e6cff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853134.633238:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20400/0x710df789068e6cff lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853134.633254:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20400/0x710df789068e6cff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853134.633260:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4921e20400 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:3.0:1787853134.633263:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20400/0x710df789068e6cff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853134.633270:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20400/0x710df789068e6cff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853134.633278:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8f4910f92f00) 00010000:00010000:3.0:1787853134.633281:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787853134.633284:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20400/0x710df789068e6cff lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853134.633290:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20400/0x710df789068e6cff lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853134.633344:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21a00/0x710df789068e6cf1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793898bf expref: 56 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853134.633362:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21c00/0x710df789068e6d06 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793898bf expref: 55 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853134.633370:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f491176b700) 00010000:00010000:3.0:1787853134.633372:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787853134.633375:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4921e21c00, rc 0) 00000100:00100000:3.0:1787853134.633470:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4934117840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+55:11498:x1874699526155264:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 989us (1276us total) trans 4294967453 rc 0/0 00000100:00100000:3.0:1787853134.633489:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 165 00010000:00010000:0.0:1787853134.635139:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787853134.638740:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853134.638864:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853134.638980:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526155520 00000100:00100000:0.0:1787853134.638995:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526155520 00000100:00100000:0.0:1787853134.639080:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 166 00000100:00100000:0.0:1787853134.639092:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f492eb98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+55:11498:x1874699526155520:12345-192.168.204.1@tcp:54:lfs.0 00010000:00010000:0.0:1787853134.639191:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7e00/0x710df789068e6d14 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853134.639213:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7e00/0x710df789068e6d14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853134.639227:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7e00/0x710df789068e6d14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853134.639263:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7e00/0x710df789068e6d14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853134.639270:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7e00/0x710df789068e6d14 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853134.639277:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7e00/0x710df789068e6d14 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853134.639284:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b7e00 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:0.0:1787853134.639289:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7e00/0x710df789068e6d14 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853134.639297:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7e00/0x710df789068e6d14 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853134.639314:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f491176b700) 00010000:00010000:0.0:1787853134.639317:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787853134.639324:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7e00/0x710df789068e6d14 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853134.639340:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7e00/0x710df789068e6d14 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853134.639436:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f492eb98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+55:11498:x1874699526155520:12345-192.168.204.1@tcp:54:lfs.0 Request processed in 347us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853134.639445:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 166 00000100:00100000:3.0:1787853134.639793:0:11175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526155392 00000100:00100000:3.0:1787853134.639801:0:11175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526155392 00000100:00100000:3.0:1787853134.639846:0:11175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 12 00000100:00100000:3.0:1787853134.639855:0:11175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f492eb99a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b1d98f5a-0be0-4f69-83a6-833c935c8205+55:2362:x1874699526155392:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787853134.639869:0:11175:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787853134.639892:0:11175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21c00/0x710df789068e6d06 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793898bf expref: 55 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853134.639908:0:11175:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f491176b700) 00010000:00010000:3.0:1787853134.639912:0:11175:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787853134.639954:0:11175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f492eb99a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b1d98f5a-0be0-4f69-83a6-833c935c8205+54:2362:x1874699526155392:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 101us (1231us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853134.639961:0:11175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 12 00000100:00100000:1.0:1787853134.649487:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853134.649722:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526155776 00000100:00100000:3.0:1787853134.649740:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526155776 00000100:00100000:3.0:1787853134.649809:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 47 00000100:00100000:3.0:1787853134.649821:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f492eb98b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+54:11498:x1874699526155776:12345-192.168.204.1@tcp:35:lfs.0 00000100:00100000:3.0:1787853134.650185:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f492eb98b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+55:11498:x1874699526155776:12345-192.168.204.1@tcp:35:lfs.0 Request processed in 366us (718us total) trans 4294967454 rc 0/0 00000100:00100000:3.0:1787853134.650194:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 47 00000100:00100000:3.0:1787853134.912312:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853134.912609:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526156032 00000100:00100000:0.0:1787853134.912630:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526156032 00000100:00100000:0.0:1787853134.912718:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 167 00000100:00100000:0.0:1787853134.912731:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493c58d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+55:11516:x1874699526156032:12345-192.168.204.1@tcp:101:cat.0 00010000:00010000:0.0:1787853134.912766:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853134.912797:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7e00/0x710df789068e6d1b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c50793898c6 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853134.912939:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e6d22 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853134.912958:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e6d22 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853134.912973:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e6d22 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787853134.912987:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1787853134.913183:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7e00/0x710df789068e6d1b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793898c6 expref: 58 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853134.913209:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e6d22 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793898c6 expref: 57 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853134.913237:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f491176b700) 00010000:00010000:0.0:1787853134.913240:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787853134.913245:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49415b7c00, rc 0) 00000100:00100000:0.0:1787853134.914179:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493c58d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+57:11516:x1874699526156032:12345-192.168.204.1@tcp:101:cat.0 Request processed in 1442us (1875us total) trans 4294967455 rc 0/0 00000100:00100000:0.0:1787853134.914192:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 167 00000100:00100000:1.0:1787853134.947168:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853134.947427:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526156160 00000100:00100000:0.0:1787853134.947440:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526156160 00000100:00100000:0.0:1787853134.947520:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 168 00000100:00100000:0.0:1787853134.947533:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f492eb9a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+57:11517:x1874699526156160:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:0.0:1787853134.947567:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853134.947633:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7e00/0x710df789068e6d30 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c50793898cd expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853134.947739:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7200/0x710df789068e6d37 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853134.947756:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7200/0x710df789068e6d37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853134.947771:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7200/0x710df789068e6d37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787853134.947850:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:0.0:1787853134.947854:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787853134.947881:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7200/0x710df789068e6d37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853134.947947:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7e00/0x710df789068e6d30 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793898cd expref: 59 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853134.948182:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7200/0x710df789068e6d37 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793898cd expref: 58 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853134.948193:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8f4910f92100) 00010000:00010000:0.0:1787853134.948196:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787853134.948199:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49415b7200, rc 0) 00000100:00100000:0.0:1787853134.948288:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f492eb9a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+58:11517:x1874699526156160:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 757us (1134us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853134.948296:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 168 00000100:00100000:3.0:1787853134.953078:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853134.953235:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526156544 00000100:00100000:1.0:1787853134.953251:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526156544 00000100:00100000:1.0:1787853134.953343:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 48 00000100:00100000:1.0:1787853134.953355:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493c58cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+58:11517:x1874699526156544:12345-192.168.204.1@tcp:35:lfs.0 00000100:00100000:1.0:1787853134.954122:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493c58cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+59:11517:x1874699526156544:12345-192.168.204.1@tcp:35:lfs.0 Request processed in 766us (1062us total) trans 4294967456 rc 0/0 00000100:00100000:1.0:1787853134.954132:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 48 00000100:00100000:3.0:1787853134.956940:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853134.957190:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526156672 00000100:00100000:1.0:1787853134.957202:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526156672 00000100:00100000:1.0:1787853134.957289:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 13 00000100:00100000:1.0:1787853134.957301:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493c58da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+59:11517:x1874699526156672:12345-192.168.204.1@tcp:103:lfs.0 00010000:00010000:1.0:1787853134.957321:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1787853134.957359:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7000/0x710df789068e6cc7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793898b1 expref: 59 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853134.957423:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e6d22 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793898c6 expref: 58 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853134.957435:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7600/0x710df789068e6bd2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389872 expref: 57 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853134.957446:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f491176b700) 00010000:00010000:1.0:1787853134.957461:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787853134.958541:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493c58da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+56:11517:x1874699526156672:12345-192.168.204.1@tcp:103:lfs.0 Request processed in 1233us (1623us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853134.958557:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 13 00000100:00100000:3.0:1787853134.965030:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853134.965122:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526156800 00000100:00100000:0.0:1787853134.965136:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526156800 00000100:00100000:0.0:1787853134.965212:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 169 00000100:00100000:0.0:1787853134.965224:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493c58c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+56:11517:x1874699526156800:12345-192.168.204.1@tcp:58:lfs.0 00010000:00010000:0.0:1787853134.965386:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7e00/0x710df789068e6d3e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853134.965417:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7e00/0x710df789068e6d3e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853134.965433:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7e00/0x710df789068e6d3e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787853134.965742:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:0.0:1787853134.966555:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493c58c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+56:11517:x1874699526156800:12345-192.168.204.1@tcp:58:lfs.0 Request processed in 1327us (1538us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853134.966604:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 169 00000100:00100000:3.0:1787853134.990789:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853134.990933:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526156928 00000100:00100000:1.0:1787853134.990948:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526156928 00000100:00100000:1.0:1787853134.991040:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 170 00000100:00100000:1.0:1787853134.991051:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493c58cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+56:11519:x1874699526156928:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:1.0:1787853134.991079:0:8462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853134.991107:0:8462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ada00/0x710df789068e6d45 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c50793898d4 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853134.991210:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad000/0x710df789068e6d4c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853134.991229:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad000/0x710df789068e6d4c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853134.991243:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad000/0x710df789068e6d4c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853134.991294:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ac000/0x710df789068e6d53 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853134.991302:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ac000/0x710df789068e6d53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853134.991309:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ac000/0x710df789068e6d53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853134.991451:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e6d5a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853134.991460:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e6d5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853134.991467:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e6d5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787853134.991519:0:8462:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1787853134.991525:0:8462:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787853134.991549:0:8462:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e6d5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853134.991563:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e6d5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853134.991628:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad000/0x710df789068e6d4c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853134.991636:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad000/0x710df789068e6d4c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853134.991654:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad000/0x710df789068e6d4c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853134.991673:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f492a8ad000 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:1.0:1787853134.991678:0:8462:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad000/0x710df789068e6d4c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853134.991687:0:8462:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad000/0x710df789068e6d4c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853134.991701:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8f4910f92100) 00010000:00010000:1.0:1787853134.991704:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787853134.991710:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad000/0x710df789068e6d4c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853134.991716:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad000/0x710df789068e6d4c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853134.991733:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ac000/0x710df789068e6d53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853134.991739:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ac000/0x710df789068e6d53 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853134.991745:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ac000/0x710df789068e6d53 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853134.991750:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f492a8ac000 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:1.0:1787853134.991753:0:8462:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ac000/0x710df789068e6d53 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853134.991770:0:8462:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ac000/0x710df789068e6d53 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853134.991779:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8f4914d11c00) 00010000:00010000:1.0:1787853134.991782:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787853134.991785:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ac000/0x710df789068e6d53 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853134.991791:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ac000/0x710df789068e6d53 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853134.991831:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ada00/0x710df789068e6d45 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793898d4 expref: 58 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853134.991847:0:8462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e6d5a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793898d4 expref: 57 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853134.991855:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f491176bf00) 00010000:00010000:1.0:1787853134.991856:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787853134.991860:0:8462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f492a8ad200, rc 0) 00000100:00100000:1.0:1787853134.991971:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493c58cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+57:11519:x1874699526156928:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 920us (1197us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853134.991980:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 170 00000040:00080000:2.0:1787853135.660538:0:11690:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787853135.660550:0:11690:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787853135.660735:0:11690:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1787853135.660746:0:11690:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787853135.660929:0:11690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f493fdd7c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11690:1874699552374400:192.168.204.1@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787853135.661058:0:11690:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f4909be4000 going to sleep for 11 seconds 00010000:00010000:0.0:1787853135.661559:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787853135.673488:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853135.673563:0:11690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f493fdd7c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11690:1874699552374400:192.168.204.1@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787853135.673894:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526157056 00000100:00100000:1.0:1787853135.673903:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526157056 00000100:00100000:1.0:1787853135.673991:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 171 00000100:00100000:1.0:1787853135.674001:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f492eb9b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+57:11530:x1874699526157056:12345-192.168.204.1@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787853135.674044:0:5837:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787853135.674194:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f492eb9b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+57:11530:x1874699526157056:12345-192.168.204.1@tcp:53:lhsmtool_posix.0 Request processed in 193us (722us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853135.674203:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 171 00000100:00080000:1.0:1787853135.674235:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787853135.704498:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853135.704977:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526157184 00000100:00100000:3.0:1787853135.704993:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526157184 00000100:00100000:3.0:1787853135.705073:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 172 00000100:00100000:3.0:1787853135.705086:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f492eb983c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+57:11530:x1874699526157184:12345-192.168.204.1@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787853135.705194:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21c00/0x710df789068e6d61 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853135.705217:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21c00/0x710df789068e6d61 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853135.705233:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21c00/0x710df789068e6d61 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853135.705333:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21a00/0x710df789068e6d68 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853135.705343:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21a00/0x710df789068e6d68 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853135.705351:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21a00/0x710df789068e6d68 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853135.705386:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20400/0x710df789068e6d6f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853135.705398:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20400/0x710df789068e6d6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853135.705405:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20400/0x710df789068e6d6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787853135.705483:0:8462:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1787853135.705488:0:8462:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787853135.705509:0:8462:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20400/0x710df789068e6d6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853135.705525:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21c00/0x710df789068e6d61 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853135.705533:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21c00/0x710df789068e6d61 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853135.705540:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21c00/0x710df789068e6d61 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853135.705547:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4921e21c00 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:3.0:1787853135.705553:0:8462:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21c00/0x710df789068e6d61 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853135.705562:0:8462:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21c00/0x710df789068e6d61 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853135.706400:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f4914d11600) 00010000:00010000:3.0:1787853135.706406:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787853135.706415:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21c00/0x710df789068e6d61 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853135.706424:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21c00/0x710df789068e6d61 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853135.706446:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21a00/0x710df789068e6d68 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853135.706470:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21a00/0x710df789068e6d68 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853135.706478:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21a00/0x710df789068e6d68 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853135.706484:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4921e21a00 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:3.0:1787853135.706489:0:8462:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21a00/0x710df789068e6d68 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853135.706497:0:8462:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21a00/0x710df789068e6d68 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853135.706506:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff8f4910f92f00) 00010000:00010000:3.0:1787853135.706509:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787853135.706513:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21a00/0x710df789068e6d68 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853135.706521:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21a00/0x710df789068e6d68 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853135.706541:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20400/0x710df789068e6d6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853135.706548:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20400/0x710df789068e6d6f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853135.706553:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20400/0x710df789068e6d6f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853135.706559:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4921e20400 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:3.0:1787853135.706593:0:8462:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20400/0x710df789068e6d6f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853135.706601:0:8462:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20400/0x710df789068e6d6f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853135.706610:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f491176bf00) 00010000:00010000:3.0:1787853135.707506:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787853135.707518:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20400/0x710df789068e6d6f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853135.707529:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20400/0x710df789068e6d6f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853135.710752:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f492eb983c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+57:11530:x1874699526157184:12345-192.168.204.1@tcp:34:lhsmtool_posix.0 Request processed in 5650us (6248us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853135.710772:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 172 00000100:00100000:0.0:1787853135.718269:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853135.718413:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526157440 00000100:00100000:1.0:1787853135.718428:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526157440 00000100:00100000:1.0:1787853135.718503:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 173 00000100:00100000:1.0:1787853135.718515:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493c5fcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+57:11530:x1874699526157440:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787853135.718545:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853135.718598:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad600/0x710df789068e6d76 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c50793898db expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853135.721505:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad000/0x710df789068e6d7d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853135.721536:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad000/0x710df789068e6d7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853135.721550:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad000/0x710df789068e6d7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787853135.721566:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1787853135.721864:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad000/0x710df789068e6d7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853135.721887:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad000/0x710df789068e6d7d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853135.721896:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad000/0x710df789068e6d7d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853135.721903:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f492a8ad000 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:1.0:1787853135.721909:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad000/0x710df789068e6d7d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853135.721918:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad000/0x710df789068e6d7d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853135.721934:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f491176bf00) 00010000:00010000:1.0:1787853135.721937:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787853135.721942:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad000/0x710df789068e6d7d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853135.721948:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad000/0x710df789068e6d7d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853135.722009:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad600/0x710df789068e6d76 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793898db expref: 59 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853135.722021:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f4914d11600) 00010000:00010000:1.0:1787853135.722023:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787853135.722026:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad600/0x710df789068e6d76 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793898db expref: 59 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853135.722036:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f492a8ad600, rc 0) 00000100:00100000:1.0:1787853135.722140:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493c5fcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+58:11530:x1874699526157440:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 Request processed in 3626us (3894us total) trans 4294967457 rc 301/301 00000100:00100000:1.0:1787853135.722151:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 173 00000100:00100000:0.0:1787853135.750409:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853135.750799:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526157568 00000100:00100000:1.0:1787853135.750813:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526157568 00000100:00100000:1.0:1787853135.750892:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 174 00000100:00100000:1.0:1787853135.750905:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493c5ff840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+58:11530:x1874699526157568:12345-192.168.204.1@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787853135.750953:0:5836:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787853135.751099:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493c5ff840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+58:11530:x1874699526157568:12345-192.168.204.1@tcp:53:lhsmtool_posix.0 Request processed in 196us (705us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853135.751108:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 174 00000001:00080000:1.0:1787853135.757290:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967455 is committed 00000004:00080000:1.0:1787853135.757315:0:5858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:1.0:1787853135.757339:0:5858:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8f49419c4240 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:1.0:1787853135.757345:0:5858:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8f493fef8800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8f49419c4480 00000020:00080000:1.0:1787853135.757348:0:5858:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8f490636a900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8f49065d3000 00000020:00080000:0.0:1787853135.757402:0:5870:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:0.0:1787853135.757658:0:5870:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000001:00080000:1.0:1787853135.758104:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967456 is committed 00000100:00100000:0.0:1787853135.758691:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f492eb9b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874699552374528:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787853135.758797:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853135.759018:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552374528 00000100:00100000:3.0:1787853135.759030:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552374528 00000100:00100000:3.0:1787853135.759134:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787853135.759146:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493c5fde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1874699552374528:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1787853135.759181:0:6682:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00002000:00010000:3.0:1787853135.759229:0:6682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a90794c, atime: 0x6a90794c, ctime: 0x6a90794c, blocks: 0xb 00010000:00010000:3.0:1787853135.759238:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7ed99ec/0x710df789068e6d8b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853135.759277:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=455s v=(0 0) 00010000:00010000:3.0:1787853135.759283:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787853135.759292:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d7ed99ec/0x710df789068e6d8b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853135.759341:0:6682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d7ed99ec/0x710df789068e6d8b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853135.759355:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7ed99ec/0x710df789068e6d8b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853135.759364:0:6682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d7ed99ec/0x710df789068e6d8b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853135.759400:0:6682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:1.0:1787853135.760240:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787853135.761614:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787853135.761631:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d7ed99ec/0x710df789068e6d8b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853135.761660:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4921e20400 already unused, calling callback (ffffffffc1528440) 00010000:00010000:1.0:1787853135.761665:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7ed99ec/0x710df789068e6d8b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853135.761699:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7ed99ec/0x710df789068e6d8b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853135.761729:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d7ed99ec/0x710df789068e6d8b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853135.761737:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d7ed99ec/0x710df789068e6d8b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853135.761768:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853135.761770:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853135.761772:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787853135.767637:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493c5fde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3309:x1874699552374528:12345-0@lo:6:osp-syn-1-0.0 Request processed in 8468us (8814us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1787853135.767667:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787853135.768560:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853135.768753:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526157824 00000100:00100000:0.0:1787853135.768766:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526157824 00000100:00100000:0.0:1787853135.768841:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 175 00000100:00100000:0.0:1787853135.768852:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493fdd4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+17:11530:x1874699526157824:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787853135.768883:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853135.768887:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787853135.768925:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7200/0x710df789068e6d37 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793898cd expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853135.768950:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8f4910f92100) 00010000:00010000:0.0:1787853135.768955:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787853135.768973:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7800/0x710df789068e6d92 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c50793898e2 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787853135.770091:0:5837:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:0.0:1787853135.774879:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6600/0x710df789068e6d99 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853135.774913:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6600/0x710df789068e6d99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853135.774951:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6600/0x710df789068e6d99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853135.775063:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7800/0x710df789068e6d92 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793898e2 expref: 19 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853135.775094:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6600/0x710df789068e6d99 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793898e2 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853135.775106:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8f491176bb00) 00010000:00010000:0.0:1787853135.775109:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787853135.775114:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49415b6600, rc 0) 00000100:00100000:0.0:1787853135.775223:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493fdd4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+18:11530:x1874699526157824:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 Request processed in 6371us (6669us total) trans 4294967458 rc 0/0 00000100:00100000:0.0:1787853135.775234:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 175 00000100:00100000:1.0:1787853135.775669:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:1.0:1787853135.775679:0:3309:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:1.0:1787853135.775718:0:3309:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8f492eb9b0c0 x1874699552374528/t4294967307(4294967307) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787853151 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1787853135.775733:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8f492eb9b0c0/2, rc 0, transno 4294967307 00000100:00100000:1.0:1787853135.775740:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f492eb9b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874699552374528:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787853135.784311:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853135.784408:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526158080 00000100:00100000:1.0:1787853135.784423:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526158080 00000100:00100000:1.0:1787853135.784500:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 176 00000100:00100000:1.0:1787853135.784513:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493c5fda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+18:11530:x1874699526158080:12345-192.168.204.1@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787853135.784640:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787853135.784696:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6600/0x710df789068e6d99 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793898e2 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853135.784748:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8f491176bb00) 00010000:00010000:1.0:1787853135.784763:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787853135.784802:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ac000/0x710df789068e6da7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853135.784821:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ac000/0x710df789068e6da7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853135.784836:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ac000/0x710df789068e6da7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853135.784861:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ada00/0x710df789068e6dae lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x6a4cfaed bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853135.784868:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ada00/0x710df789068e6dae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x6a4cfaed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853135.784875:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ada00/0x710df789068e6dae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x6a4cfaed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853135.785244:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ac000/0x710df789068e6da7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853135.785255:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ac000/0x710df789068e6da7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853135.785262:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ac000/0x710df789068e6da7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853135.785269:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f492a8ac000 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:1.0:1787853135.785276:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ac000/0x710df789068e6da7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853135.785292:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ac000/0x710df789068e6da7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853135.785303:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8f4910f92100) 00010000:00010000:1.0:1787853135.785306:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787853135.785311:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ac000/0x710df789068e6da7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853135.785318:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ac000/0x710df789068e6da7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853135.785330:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ada00/0x710df789068e6dae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x6a4cfaed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853135.785336:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ada00/0x710df789068e6dae lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x6a4cfaed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853135.785341:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ada00/0x710df789068e6dae lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x6a4cfaed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853135.785347:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f492a8ada00 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:1.0:1787853135.785350:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ada00/0x710df789068e6dae lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x6a4cfaed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853135.785357:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ada00/0x710df789068e6dae lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x6a4cfaed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853135.785363:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x6a4cfaed (ffff8f4914d11c00) 00010000:00010000:1.0:1787853135.785365:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787853135.785368:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ada00/0x710df789068e6dae lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x6a4cfaed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853135.785383:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ada00/0x710df789068e6dae lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x6a4cfaed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853135.785497:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493c5fda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+17:11530:x1874699526158080:12345-192.168.204.1@tcp:36:lhsmtool_posix.0 Request processed in 984us (1199us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787853135.785507:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 176 00000100:00100000:3.0:1787853135.788200:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853135.788441:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526158208 00000100:00100000:2.0:1787853135.788457:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526158208 00000100:00100000:2.0:1787853135.788541:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 177 00000100:00100000:2.0:1787853135.788554:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493c58e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+17:11530:x1874699526158208:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787853135.788624:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853135.788669:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8200/0x710df789068e6db5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c50793898e9 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853135.788749:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9e00/0x710df789068e6dbc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853135.788765:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9e00/0x710df789068e6dbc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853135.788779:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9e00/0x710df789068e6dbc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853135.789052:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8200/0x710df789068e6db5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793898e9 expref: 19 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853135.789079:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9e00/0x710df789068e6dbc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793898e9 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853135.789089:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8f4910aab300) 00010000:00010000:2.0:1787853135.789093:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787853135.789098:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49415b9e00, rc 0) 00000100:00100000:2.0:1787853135.789269:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493c58e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+18:11530:x1874699526158208:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 Request processed in 717us (1087us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853135.789279:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 177 00000100:00100000:2.0:1787853135.805054:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853135.807511:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526158464 00000100:00100000:1.0:1787853135.807532:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526158464 00000100:00100000:1.0:1787853135.807777:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 178 00000100:00100000:1.0:1787853135.807790:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493fdd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+18:11530:x1874699526158464:12345-192.168.204.1@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787853135.807911:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad600/0x710df789068e6dc3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853135.807933:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad600/0x710df789068e6dc3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853135.807950:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad600/0x710df789068e6dc3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787853135.812955:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:1.0:1787853135.812996:0:5836:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 455354424603ns, next at 456354417838ns, rc = 0 00000004:00010000:1.0:1787853135.813185:0:5836:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000064849b51 reply state 00000000a02e4134 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad600/0x710df789068e6dc3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853135.813202:0:5836:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787853135.813936:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493fdd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+20:11530:x1874699526158464:12345-192.168.204.1@tcp:36:lhsmtool_posix.0 Request processed in 6139us (8887us total) trans 4294967459 rc 0/0 00000100:00100000:1.0:1787853135.813950:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 178 00000100:00100000:1.0:1787853135.824675:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853135.824828:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526158592 00000100:00100000:3.0:1787853135.824845:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526158592 00000100:00100000:3.0:1787853135.824929:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 179 00000100:00100000:3.0:1787853135.824942:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f492eb99680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+20:11530:x1874699526158592:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787853135.824977:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853135.825009:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21a00/0x710df789068e6dca lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c50793898f0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853135.825096:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21a00/0x710df789068e6dca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793898f0 expref: 21 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853135.825143:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21a00/0x710df789068e6dca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793898f0 expref: 21 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853135.825168:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8f4910aab300) 00010000:00010000:3.0:1787853135.825172:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787853135.825178:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4921e21a00, rc 0) 00000100:00100000:3.0:1787853135.825275:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f492eb99680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+21:11530:x1874699526158592:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 Request processed in 335us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853135.825283:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 179 00010000:00010000:0.0:1787853135.825706:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad600/0x710df789068e6dc3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853135.825723:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad600/0x710df789068e6dc3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853135.825732:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad600/0x710df789068e6dc3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853135.825740:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f492a8ad600 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:0.0:1787853135.825746:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad600/0x710df789068e6dc3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853135.825773:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad600/0x710df789068e6dc3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853135.825794:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8f4910aab300) 00010000:00010000:0.0:1787853135.825797:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787853135.825802:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad600/0x710df789068e6dc3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853135.825809:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad600/0x710df789068e6dc3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853135.838917:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853135.839099:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526158720 00000100:00100000:2.0:1787853135.839113:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526158720 00000100:00100000:2.0:1787853135.839190:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 53 00000100:00100000:2.0:1787853135.839202:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493c58f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+6:2363:x1874699526158720:12345-192.168.204.1@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1787853135.839772:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493c58f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+7:2363:x1874699526158720:12345-192.168.204.1@tcp:2:lhsmtool_posix.0 Request processed in 570us (872us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1787853135.839803:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 53 00000100:00100000:2.0:1787853135.843283:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853135.843527:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526158976 00000100:00100000:3.0:1787853135.843542:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526158976 00000100:00100000:3.0:1787853135.843676:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 49 00000100:00100000:3.0:1787853135.843688:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493fdd4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+20:11530:x1874699526158976:12345-192.168.204.1@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787853135.844069:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493fdd4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+21:11530:x1874699526158976:12345-192.168.204.1@tcp:35:lhsmtool_posix.0 Request processed in 380us (820us total) trans 4294967460 rc 0/0 00000100:00100000:3.0:1787853135.844078:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 49 00000100:00100000:0.0:1787853135.864048:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853135.864144:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526159232 00000100:00100000:1.0:1787853135.864158:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526159232 00000100:00100000:1.0:1787853135.864218:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 180 00000100:00100000:1.0:1787853135.864229:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4921697840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+21:11530:x1874699526159232:12345-192.168.204.1@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787853135.864382:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4921697840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+21:11530:x1874699526159232:12345-192.168.204.1@tcp:57:lhsmtool_posix.0 Request processed in 154us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853135.864392:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 180 00000100:00100000:3.0:1787853135.867323:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853135.867422:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526159360 00000100:00100000:0.0:1787853135.867437:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526159360 00000100:00100000:0.0:1787853135.867521:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 181 00000100:00100000:0.0:1787853135.867535:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493c58c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+21:11530:x1874699526159360:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787853135.867564:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853135.867764:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6a00/0x710df789068e6dd1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c50793898f7 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853135.867870:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6e00/0x710df789068e6dd8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853135.867891:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6e00/0x710df789068e6dd8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853135.867905:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6e00/0x710df789068e6dd8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787853135.868132:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787853135.868181:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6e00/0x710df789068e6dd8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853135.868214:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6a00/0x710df789068e6dd1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793898f7 expref: 23 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853135.868237:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6e00/0x710df789068e6dd8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793898f7 expref: 22 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853135.868245:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8f4910aab300) 00010000:00010000:0.0:1787853135.868249:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787853135.868254:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49415b6e00, rc 0) 00000100:00100000:0.0:1787853135.868340:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493c58c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+22:11530:x1874699526159360:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 Request processed in 808us (1032us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853135.868348:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 181 00000100:00100000:0.0:1787853135.875508:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853135.875590:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526159488 00000100:00100000:0.0:1787853135.875605:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526159488 00000100:00100000:0.0:1787853135.875707:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 54 00000100:00100000:0.0:1787853135.875721:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4803aade00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+7:2363:x1874699526159488:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787853135.875750:0:8463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853135.875782:0:8463:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005ca8e832/0x710df789068e6ddf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c50793898fe expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787853135.875823:0:8463:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a907950, blocks: 0x1 00010000:00010000:0.0:1787853135.875853:0:8463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=455s v=(0 0) 00010000:00010000:0.0:1787853135.875859:0:8463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787853135.875871:0:8463:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005ca8e832/0x710df789068e6ddf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793898fe expref: 8 pid: 8463 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853135.875905:0:8463:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005ca8e832/0x710df789068e6ddf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793898fe expref: 8 pid: 8463 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853135.875925:0:8463:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49415b6400, rc 0) 00000100:00100000:0.0:1787853135.876020:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4803aade00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+8:2363:x1874699526159488:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 Request processed in 302us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853135.876029:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 54 00000100:00100000:2.0:1787853135.888734:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853135.888817:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526159744 00000100:00100000:2.0:1787853135.888831:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526159744 00000100:00100000:2.0:1787853135.888902:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 182 00000100:00100000:2.0:1787853135.888914:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493fdd7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+22:11530:x1874699526159744:12345-192.168.204.1@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787853135.889070:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493fdd7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+22:11530:x1874699526159744:12345-192.168.204.1@tcp:57:lhsmtool_posix.0 Request processed in 157us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853135.889078:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 182 00000100:00100000:2.0:1787853135.894826:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853135.894917:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526159872 00000100:00100000:3.0:1787853135.894930:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526159872 00000100:00100000:3.0:1787853135.895009:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 55 00000100:00100000:3.0:1787853135.895021:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4941af1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+8:11530:x1874699526159872:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787853135.895049:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853135.895078:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007eb7803c/0x710df789068e6de6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c5079389905 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853135.895149:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005ca8e832/0x710df789068e6ddf lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793898fe expref: 9 pid: 8463 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853135.895161:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787853135.895167:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787853135.895173:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007eb7803c/0x710df789068e6de6 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389905 expref: 9 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853135.895216:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005ca8e832/0x710df789068e6ddf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793898fe expref: 9 pid: 8463 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853135.895233:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005ca8e832/0x710df789068e6ddf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793898fe expref: 9 pid: 8463 timeout: 555 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853135.895263:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f493c58d680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6682:1874699552374656:192.168.204.1@tcp:104: 00000100:00100000:3.0:1787853135.895390:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f4905074600 going to sleep for 11 seconds 00000100:00100000:2.0:1787853135.899262:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853135.899698:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f493c58d680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6682:1874699552374656:192.168.204.1@tcp:104: 00010000:00010000:3.0:1787853135.899745:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007eb7803c/0x710df789068e6de6 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389905 expref: 9 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853135.899774:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4921e21c00, rc 0) 00000100:00100000:3.0:1787853135.899881:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4941af1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+9:11530:x1874699526159872:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 Request processed in 4861us (5070us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853135.899894:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 55 00000100:00100000:3.0:1787853135.899963:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526160000 00000100:00100000:3.0:1787853135.899971:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526160000 00010000:00010000:3.0:1787853135.900012:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005ca8e832/0x710df789068e6ddf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793898fe expref: 9 pid: 8463 timeout: 555 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853135.900047:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 68 00000100:00100000:3.0:1787853135.900058:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4941af3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+9:2363:x1874699526160000:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787853135.900075:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787853135.900107:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005ca8e832/0x710df789068e6ddf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793898fe expref: 9 pid: 8463 timeout: 555 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853135.900120:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005ca8e832/0x710df789068e6ddf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793898fe expref: 9 pid: 8463 timeout: 555 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853135.900152:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005ca8e832/0x710df789068e6ddf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793898fe expref: 9 pid: 8463 timeout: 555 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853135.900170:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787853135.900174:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787853135.900185:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007eb7803c/0x710df789068e6de6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389905 expref: 8 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853135.900196:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007eb7803c/0x710df789068e6de6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389905 expref: 8 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853135.900235:0:5822:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000007eb7803c/0x710df789068e6de6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389905 expref: 8 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853135.900763:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f493c58d680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5822:1874699552374784:192.168.204.1@tcp:105: 00000100:00100000:3.0:1787853135.900852:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f4905074600 going to sleep for 11 seconds 00000100:00100000:3.0:1787853135.908485:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f493c58d680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5822:1874699552374784:192.168.204.1@tcp:105: 00010000:00010000:3.0:1787853135.908524:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787853135.908617:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4941af3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+8:2363:x1874699526160000:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 8559us (9375us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853135.908630:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 68 00000100:00100000:2.0:1787853135.912486:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853135.913053:0:12023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526160128 00000100:00100000:0.0:1787853135.913069:0:12023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526160128 00002000:00100000:0.0:1787853135.913150:0:12023:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff8f49056da940 x1874699526160128/t0(0) o4->b1d98f5a-0be0-4f69-83a6-833c935c8205@192.168.204.1@tcp:311/0 lens 504/0 e 0 to 0 dl 1787853146 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787853135.913164:0:12023:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff8f49056da940 with x1874699526160128 ext(0->8) 00002000:00010000:0.0:1787853135.913172:0:12023:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8f49056da940 00000100:00100000:0.0:1787853135.913213:0:12023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 5 00000100:00100000:0.0:1787853135.913224:0:12023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49056da940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+8:2364:x1874699526160128:12345-192.168.204.1@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1787853135.917758:0:12023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49056da940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+10:2364:x1874699526160128:12345-192.168.204.1@tcp:4:lhsmtool_posix.0 Request processed in 4513us (5263us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1787853135.917780:0:12023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 5 00002000:00100000:0.0:1787853135.917799:0:12023:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff8f49056da940 x1874699526160128/t4294967315(0) o4->b1d98f5a-0be0-4f69-83a6-833c935c8205@192.168.204.1@tcp:311/0 lens 504/448 e 0 to 0 dl 1787853146 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787853135.917811:0:12023:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff8f49056da940 with x1874699526160128 ext(0->8) 00002000:00010000:0.0:1787853135.917820:0:12023:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8f49056da940 00000100:00100000:3.0:1787853135.923895:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853135.927041:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526160256 00000100:00100000:1.0:1787853135.927063:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526160256 00000100:00100000:1.0:1787853135.927160:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 183 00000100:00100000:1.0:1787853135.927174:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493c58d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+22:11530:x1874699526160256:12345-192.168.204.1@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1787853136.030511:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493c58d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+22:11530:x1874699526160256:12345-192.168.204.1@tcp:44:lhsmtool_posix.0 Request processed in 103321us (106611us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853136.030533:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 183 00000001:00080000:1.0:1787853136.030615:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967458 is committed 00000020:00080000:1.0:1787853136.030629:0:5858:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000001:00080000:1.0:1787853136.030656:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967459 is committed 00000004:00080000:1.0:1787853136.030662:0:5858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000001:00080000:1.0:1787853136.030680:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000020:00080000:1.0:1787853136.030695:0:5870:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:1.0:1787853136.030715:0:5870:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1787853136.030874:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f492eb9a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552374912:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787853136.030952:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853136.031347:0:12025:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552374912 00000100:00100000:1.0:1787853136.031358:0:12025:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552374912 00000100:00100000:1.0:1787853136.031435:0:12025:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787853136.031453:0:12025:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4905755850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3306:x1874699552374912:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1787853136.031713:0:12025:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1787853136.031718:0:12025:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787853136 00002000:00010000:1.0:1787853136.031721:0:12025:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787853136.031723:0:12025:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1787853136 -> 1787853136 00002000:00010000:1.0:1787853136.031726:0:12025:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1787853136.031783:0:12025:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4905755850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3306:x1874699552374912:12345-0@lo:2:osp-syn-0-0.0 Request processed in 332us (831us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1787853136.031793:0:12025:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:1.0:1787853136.033390:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1787853136.033466:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8f492eb9a940/2, rc 0, transno 4294967316 00000100:00100000:1.0:1787853136.033478:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f492eb9a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552374912:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1787853136.044789:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853136.046116:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526160384 00000100:00100000:1.0:1787853136.046135:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526160384 00000100:00100000:1.0:1787853136.046274:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 57 00000100:00100000:1.0:1787853136.046288:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493c58e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+10:2364:x1874699526160384:12345-192.168.204.1@tcp:16:lhsmtool_posix.0 00000100:00080000:2.0:1787853136.048400:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1787853136.166869:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000001:00080000:3.0:1787853136.166891:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967316 is committed 00000040:00080000:3.0:1787853136.169062:0:12420:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787853136.169072:0:12420:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787853136.169125:0:12420:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1787853136.169131:0:12420:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787853136.171253:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493c58e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+7:2364:x1874699526160384:12345-192.168.204.1@tcp:16:lhsmtool_posix.0 Request processed in 124947us (126460us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853136.171271:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 57 00000100:00100000:0.0:1787853136.178437:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853136.178861:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526160640 00000100:00100000:2.0:1787853136.178879:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526160640 00000100:00100000:2.0:1787853136.178976:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 184 00000100:00100000:2.0:1787853136.178999:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4803aae580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+18:11530:x1874699526160640:12345-192.168.204.1@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787853136.179080:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787853136.179133:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6e00/0x710df789068e6dd8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793898f7 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853136.179160:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8f4910aab300) 00010000:00010000:2.0:1787853136.179167:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787853136.179213:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8200/0x710df789068e6ded lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853136.179249:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8200/0x710df789068e6ded lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853136.179261:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8200/0x710df789068e6ded lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787853136.179664:0:5836:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c5d4761f reply state 00000000e2151c46 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8200/0x710df789068e6ded lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853136.179677:0:5836:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787853136.179840:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4803aae580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+19:11530:x1874699526160640:12345-192.168.204.1@tcp:36:lhsmtool_posix.0 Request processed in 852us (1411us total) trans 4294967461 rc 0/0 00000100:00100000:2.0:1787853136.179851:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 184 00010000:00010000:0.0:1787853136.191787:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8200/0x710df789068e6ded lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853136.191809:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8200/0x710df789068e6ded lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853136.191817:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8200/0x710df789068e6ded lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853136.191823:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b8200 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:0.0:1787853136.191828:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8200/0x710df789068e6ded lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853136.191837:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8200/0x710df789068e6ded lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853136.191857:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8f4910aab300) 00010000:00010000:0.0:1787853136.191860:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787853136.191866:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8200/0x710df789068e6ded lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853136.191872:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8200/0x710df789068e6ded lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853136.195624:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853136.195771:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526160768 00000100:00100000:0.0:1787853136.195782:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526160768 00000100:00100000:0.0:1787853136.195842:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 58 00000100:00100000:0.0:1787853136.195852:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49056d8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+7:2365:x1874699526160768:12345-192.168.204.1@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1787853136.196110:0:6682:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1787853136.196115:0:6682:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1787853136 -> 1787853134 00002000:00010000:0.0:1787853136.196117:0:6682:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787853132 00002000:00010000:0.0:1787853136.196136:0:6682:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1787853136 -> 1787853134 00002000:00010000:0.0:1787853136.196139:0:6682:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1787853136.196225:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49056d8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+8:2365:x1874699526160768:12345-192.168.204.1@tcp:2:lhsmtool_posix.0 Request processed in 374us (610us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1787853136.196235:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 58 00000100:00100000:2.0:1787853136.209554:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853136.210671:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526161024 00000100:00100000:3.0:1787853136.210686:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526161024 00000100:00100000:1.0:1787853136.212038:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 185 00000100:00100000:1.0:1787853136.212064:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49056d9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+18:11530:x1874699526161024:12345-192.168.204.1@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1787853136.212169:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ac000/0x710df789068e6df4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853136.212191:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9e00/0x710df789068e6dbc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793898e9 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853136.212223:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ac000/0x710df789068e6df4 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853136.212272:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9e00/0x710df789068e6dbc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793898e9 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853136.212290:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9e00/0x710df789068e6dbc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793898e9 expref: 18 pid: 5838 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853136.212308:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f492eb99e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5838:1874699552375040:192.168.204.1@tcp:104: 00000100:00100000:1.0:1787853136.212452:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f490664a600 going to sleep for 11 seconds 00000100:00100000:1.0:1787853136.216965:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f492eb99e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5838:1874699552375040:192.168.204.1@tcp:104: 00010000:00010000:1.0:1787853136.217019:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ac000/0x710df789068e6df4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853136.222916:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853136.223020:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526161152 00000100:00100000:1.0:1787853136.223036:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526161152 00010000:00010000:1.0:1787853136.223111:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9e00/0x710df789068e6dbc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793898e9 expref: 19 pid: 5838 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853136.223171:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 69 00000100:00100000:1.0:1787853136.223183:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4905684450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+19:2363:x1874699526161152:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787853136.223201:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787853136.223209:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9e00/0x710df789068e6dbc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793898e9 expref: 19 pid: 5838 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853136.223246:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9e00/0x710df789068e6dbc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793898e9 expref: 19 pid: 5838 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853136.223278:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9e00/0x710df789068e6dbc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793898e9 expref: 19 pid: 5838 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853136.223298:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8f4910aab300) 00010000:00010000:1.0:1787853136.223305:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ac000/0x710df789068e6df4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853136.223316:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ac000/0x710df789068e6df4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853136.223325:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ac000/0x710df789068e6df4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853136.223357:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787853136.223427:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4905684450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+18:2363:x1874699526161152:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 245us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853136.223435:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 69 00010000:00010000:1.0:1787853136.223515:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ac000/0x710df789068e6df4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853136.223524:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ac000/0x710df789068e6df4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853136.223564:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ac000/0x710df789068e6df4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853136.223606:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ac000/0x710df789068e6df4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853136.223614:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ac000/0x710df789068e6df4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853136.223621:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f492a8ac000 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:1.0:1787853136.223626:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ac000/0x710df789068e6df4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853136.223646:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ac000/0x710df789068e6df4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853136.223656:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8f4910aab300) 00010000:00010000:1.0:1787853136.223659:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1787853136.223664:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ac000/0x710df789068e6df4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853136.223670:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ac000/0x710df789068e6df4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853136.223713:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49056d9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+17:11530:x1874699526161024:12345-192.168.204.1@tcp:55:lhsmtool_posix.0 Request processed in 11662us (14172us total) trans 0 rc -22/-22 00000100:00100000:1.0:1787853136.223722:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 185 00000100:00100000:2.0:1787853136.229394:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853136.229533:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526161280 00000100:00100000:0.0:1787853136.229543:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526161280 00000100:00100000:0.0:1787853136.229649:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 59 00000100:00100000:0.0:1787853136.229660:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49056d9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+8:2365:x1874699526161280:12345-192.168.204.1@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787853136.229712:0:8463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000094cb213f/0x710df789068e6dfb lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853136.229739:0:8463:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007eb7803c/0x710df789068e6de6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389905 expref: 8 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853136.229749:0:8463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787853136.229754:0:8463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787853136.229759:0:8463:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000094cb213f/0x710df789068e6dfb lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853136.229815:0:8463:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007eb7803c/0x710df789068e6de6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389905 expref: 8 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853136.229831:0:8463:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007eb7803c/0x710df789068e6de6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389905 expref: 8 pid: 6682 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853136.229868:0:8463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4803aaed00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8463:1874699552375168:192.168.204.1@tcp:104: 00000100:00100000:0.0:1787853136.229953:0:8463:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f490652a9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787853136.250035:0:8463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4803aaed00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8463:1874699552375168:192.168.204.1@tcp:104: 00010000:00010000:2.0:1787853136.250085:0:8463:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000094cb213f/0x710df789068e6dfb lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853136.250104:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853136.250160:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526161408 00000100:00100000:0.0:1787853136.250171:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526161408 00010000:00010000:0.0:1787853136.250231:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007eb7803c/0x710df789068e6de6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389905 expref: 9 pid: 6682 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853136.251205:0:11175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 70 00000100:00100000:2.0:1787853136.251224:0:11175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4803aaf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b1d98f5a-0be0-4f69-83a6-833c935c8205+9:2362:x1874699526161408:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787853136.251245:0:11175:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787853136.251277:0:11175:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007eb7803c/0x710df789068e6de6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389905 expref: 9 pid: 6682 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853136.251318:0:11175:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007eb7803c/0x710df789068e6de6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389905 expref: 9 pid: 6682 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853136.254455:0:11175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007eb7803c/0x710df789068e6de6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389905 expref: 9 pid: 6682 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853136.254492:0:11175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787853136.254498:0:11175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787853136.254506:0:11175:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000094cb213f/0x710df789068e6dfb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853136.254520:0:11175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000094cb213f/0x710df789068e6dfb lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853136.254604:0:11175:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787853136.254703:0:11175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4803aaf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b1d98f5a-0be0-4f69-83a6-833c935c8205+8:2362:x1874699526161408:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 3483us (4619us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853136.254716:0:11175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 70 00010000:00010000:3.0:1787853136.258031:0:8463:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000094cb213f/0x710df789068e6dfb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853136.258061:0:8463:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000094cb213f/0x710df789068e6dfb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853136.258127:0:8463:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000094cb213f/0x710df789068e6dfb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853136.258167:0:8463:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000094cb213f/0x710df789068e6dfb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853136.258178:0:8463:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000094cb213f/0x710df789068e6dfb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853136.258187:0:8463:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b6a00 already unused, calling callback (ffffffffc1528440) 00010000:00010000:3.0:1787853136.258192:0:8463:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000094cb213f/0x710df789068e6dfb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853136.258204:0:8463:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000094cb213f/0x710df789068e6dfb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853136.258229:0:8463:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000094cb213f/0x710df789068e6dfb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853136.258238:0:8463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000094cb213f/0x710df789068e6dfb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853136.258388:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49056d9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+7:2365:x1874699526161280:12345-192.168.204.1@tcp:1:lhsmtool_posix.0 Request processed in 28722us (28999us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853136.258402:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 59 00000100:00100000:3.0:1787853136.270905:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853136.271252:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526161664 00000100:00100000:2.0:1787853136.271267:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526161664 00000100:00100000:2.0:1787853136.271353:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 186 00000100:00100000:2.0:1787853136.271364:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493c58de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+17:11530:x1874699526161664:12345-192.168.204.1@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787853136.271485:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8200/0x710df789068e6e02 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853136.271510:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8200/0x710df789068e6e02 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853136.271545:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8200/0x710df789068e6e02 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853136.271869:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8a00/0x710df789068e6e09 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853136.271883:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21a00/0x710df789068e6dca lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793898f0 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853136.271893:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8a00/0x710df789068e6e09 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853136.271937:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21a00/0x710df789068e6dca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793898f0 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853136.271955:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21a00/0x710df789068e6dca lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793898f0 expref: 18 pid: 5837 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853136.271971:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49056db0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5836:1874699552375296:192.168.204.1@tcp:104: 00000100:00100000:2.0:1787853136.272831:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f493fd0ae40 going to sleep for 11 seconds 00000100:00100000:2.0:1787853136.293819:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853136.296018:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526161792 00000100:00100000:3.0:1787853136.296038:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526161792 00010000:00010000:3.0:1787853136.296122:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21a00/0x710df789068e6dca lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793898f0 expref: 19 pid: 5837 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853136.296191:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 71 00000100:00100000:3.0:1787853136.296201:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49056dad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+19:2362:x1874699526161792:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787853136.296221:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787853136.296228:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21a00/0x710df789068e6dca lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793898f0 expref: 19 pid: 5837 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853136.296244:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21a00/0x710df789068e6dca lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793898f0 expref: 19 pid: 5837 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853136.296274:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8f4910aab300) 00010000:00010000:3.0:1787853136.296281:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8a00/0x710df789068e6e09 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853136.296292:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8a00/0x710df789068e6e09 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853136.296301:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8a00/0x710df789068e6e09 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853136.296323:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787853136.296901:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21a00/0x710df789068e6dca lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793898f0 expref: 19 pid: 5837 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853136.296925:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49056db0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5836:1874699552375296:192.168.204.1@tcp:104: 00010000:00010000:1.0:1787853136.296952:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8a00/0x710df789068e6e09 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853136.296975:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8a00/0x710df789068e6e09 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853136.296983:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8a00/0x710df789068e6e09 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787853136.297275:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000100:00100000:3.0:1787853136.298184:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49056dad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+19:2362:x1874699526161792:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 1975us (4373us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853136.298199:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 71 00000001:00080000:0.0:1787853136.300643:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:0.0:1787853136.300763:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:0.0:1787853136.300911:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4803aafc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5836:1874699552375424:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787853136.302963:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853136.303157:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f490652a300 going to sleep for 11 seconds 00000100:00100000:1.0:1787853136.317101:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552375424 00000100:00100000:1.0:1787853136.317125:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552375424 00000100:00100000:0.0:1787853136.323856:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787853136.323873:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4803aac780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5836:x1874699552375424:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787853136.324311:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4803aac780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5836:x1874699552375424:12345-0@lo:1000:mdt00_000.0 Request processed in 442us (21362us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853136.324322:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787853136.326457:0:5836:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:2.0:1787853136.326474:0:5836:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8f492eb9a940, transno 4294967316 00000100:00100000:2.0:1787853136.326499:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4803aafc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5836:1874699552375424:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1787853136.327170:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:2.0:1787853136.327282:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49056db0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5836:1874699552375552:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787853136.327367:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853136.327429:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f493fd0acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787853136.327801:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552375552 00000100:00100000:0.0:1787853136.327814:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552375552 00000100:00100000:0.0:1787853136.327879:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787853136.327890:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4910d10780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5836:x1874699552375552:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787853136.328163:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4910d10780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5836:x1874699552375552:12345-0@lo:1000:mdt00_000.0 Request processed in 273us (794us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1787853136.328172:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787853136.328259:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49056db0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5836:1874699552375552:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1787853136.328313:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8a00/0x710df789068e6e09 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853136.328326:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8a00/0x710df789068e6e09 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853136.328336:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8a00/0x710df789068e6e09 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853136.328344:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b8a00 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:0.0:1787853136.328350:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8a00/0x710df789068e6e09 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853136.328360:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8a00/0x710df789068e6e09 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853136.328382:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8f4910aab300) 00010000:00010000:0.0:1787853136.328386:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787853136.328392:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8a00/0x710df789068e6e09 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853136.328400:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8a00/0x710df789068e6e09 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853136.328442:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7e00/0x710df789068e6d3e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853136.328449:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7e00/0x710df789068e6d3e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853136.328456:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7e00/0x710df789068e6d3e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853136.328468:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b7e00 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:0.0:1787853136.328471:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7e00/0x710df789068e6d3e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853136.328478:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7e00/0x710df789068e6d3e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853136.328489:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f491176bf00) 00010000:00010000:0.0:1787853136.328491:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787853136.328495:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7e00/0x710df789068e6d3e lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853136.328501:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7e00/0x710df789068e6d3e lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853136.328532:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6e00/0x710df789068e6e10 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853136.328550:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e6d5a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793898d4 expref: 21 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853136.328561:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6e00/0x710df789068e6e10 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853136.329249:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e6d5a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793898d4 expref: 21 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853136.329275:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e6d5a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793898d4 expref: 21 pid: 8462 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853136.329306:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4803aad2c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5836:1874699552375680:192.168.204.1@tcp:104: 00000100:00100000:0.0:1787853136.329403:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f4904c00c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787853136.338051:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853136.341961:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4803aad2c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5836:1874699552375680:192.168.204.1@tcp:104: 00010000:00010000:1.0:1787853136.342012:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6e00/0x710df789068e6e10 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853136.343854:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526161920 00000100:00100000:1.0:1787853136.343874:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526161920 00010000:00010000:1.0:1787853136.343943:0:8450:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e6d5a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793898d4 expref: 22 pid: 8462 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853136.343992:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 72 00000100:00100000:1.0:1787853136.344002:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493c58e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+22:2362:x1874699526161920:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787853136.344020:0:8450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787853136.344028:0:8450:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e6d5a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793898d4 expref: 22 pid: 8462 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853136.344043:0:8450:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e6d5a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793898d4 expref: 22 pid: 8462 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853136.344072:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e6d5a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793898d4 expref: 22 pid: 8462 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853136.344109:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f491176bf00) 00010000:00010000:1.0:1787853136.344115:0:8450:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6e00/0x710df789068e6e10 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853136.344126:0:8450:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6e00/0x710df789068e6e10 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853136.344135:0:8450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6e00/0x710df789068e6e10 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853136.344156:0:8450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787853136.344226:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493c58e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+21:2362:x1874699526161920:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 225us (6193us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853136.344233:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 72 00010000:00010000:0.0:1787853136.345515:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6e00/0x710df789068e6e10 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853136.345534:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6e00/0x710df789068e6e10 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853136.345553:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6e00/0x710df789068e6e10 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853136.345560:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6e00/0x710df789068e6e10 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853136.345780:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6e00/0x710df789068e6e10 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853136.345788:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b6e00 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:0.0:1787853136.345793:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6e00/0x710df789068e6e10 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853136.345802:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6e00/0x710df789068e6e10 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853136.345823:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f491176bf00) 00010000:00010000:0.0:1787853136.345827:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787853136.345834:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6e00/0x710df789068e6e10 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853136.345842:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6e00/0x710df789068e6e10 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853136.345883:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8200/0x710df789068e6e02 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853136.345889:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8200/0x710df789068e6e02 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853136.345896:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8200/0x710df789068e6e02 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853136.345901:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b8200 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:0.0:1787853136.345904:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8200/0x710df789068e6e02 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853136.345910:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8200/0x710df789068e6e02 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853136.345919:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f491176bf00) 00010000:00010000:0.0:1787853136.345922:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787853136.345925:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8200/0x710df789068e6e02 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853136.345930:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8200/0x710df789068e6e02 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853136.349725:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493c58de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+20:11530:x1874699526161664:12345-192.168.204.1@tcp:57:lhsmtool_posix.0 Request processed in 78344us (78819us total) trans 4294967466 rc 0/0 00000100:00100000:0.0:1787853136.349746:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 186 00000020:00080000:0.0:1787853136.349755:0:5836:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1787853136.349942:0:11690:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787853136.349948:0:11690:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787853136.350461:0:11690:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:0.0:1787853136.350472:0:11690:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787853136.355530:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853136.355606:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526162176 00000100:00100000:3.0:1787853136.355629:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526162176 00000100:00100000:3.0:1787853136.355726:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 50 00000100:00100000:3.0:1787853136.355738:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4910408c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+20:11530:x1874699526162176:12345-192.168.204.1@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787853136.356698:0:5839:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787853136.356827:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:3.0:1787853136.356891:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e6e17 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853136.356914:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e6e17 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853136.356933:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e6e17 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853136.356943:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e6e17 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853136.356950:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e6e17 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853136.356957:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e6e17 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853136.356985:0:5839:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787853136.357083:0:8449:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787853136.357101:0:8449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e6e17 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853136.357109:0:8449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4921e20000 already unused, calling callback (ffffffffc1528440) 00010000:00010000:0.0:1787853136.357114:0:8449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e6e17 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853136.357116:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4910408c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+22:11530:x1874699526162176:12345-192.168.204.1@tcp:35:lhsmtool_posix.0 Request processed in 1375us (1597us total) trans 4294967468 rc 0/0 00010000:00010000:0.0:1787853136.357124:0:8449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e6e17 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853136.357126:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 50 00000020:00080000:3.0:1787853136.357133:0:5839:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787853136.357141:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8f4910f92300) 00010000:00010000:0.0:1787853136.357144:0:8449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787853136.357149:0:8449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e6e17 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853136.357156:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e6e17 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853136.357173:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853136.357175:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853136.357177:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787853136.618000:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4910d10b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5d48a955-7010-4118-9c7d-f396984ae1ff:3307:1874699552375808:0@lo:400:kworker.0 00000100:00100000:2.0:1787853136.618044:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49056de580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874699552376064:0@lo:400:kworker.0 00000100:00100000:0.0:1787853136.618175:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49056dfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874699552375936:0@lo:400:kworker.0 00000100:00100000:2.0:1787853136.618243:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853136.618486:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552376064 00000100:00100000:2.0:1787853136.618496:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552376064 00000100:00100000:2.0:1787853136.618565:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787853136.618616:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f494159c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3309:x1874699552376064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853136.618711:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f494159c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3309:x1874699552376064:12345-0@lo:400:kworker.0 Request processed in 89us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853136.618720:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787853136.618775:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49056de580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874699552376064:0@lo:400:kworker.0 00000100:00100000:3.0:1787853136.618944:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49056ded00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1874699552376192:0@lo:400:kworker.0 00000100:00100000:3.0:1787853136.618997:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853136.619039:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787853136.619064:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f494159da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1874699552376320:0@lo:400:kworker.0 00000100:00100000:3.0:1787853136.619092:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853136.619127:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552376192 00000100:00100000:3.0:1787853136.619131:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552376192 00000100:00100000:3.0:1787853136.619174:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552376320 00000100:00100000:3.0:1787853136.619177:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552376320 00000100:00100000:3.0:1787853136.619202:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1787853136.619209:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493c58cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874699552376192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853136.619250:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493c58cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874699552376192:12345-0@lo:400:kworker.0 Request processed in 41us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853136.619256:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1787853136.619271:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1787853136.619278:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493c58ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874699552376320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853136.619306:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493c58ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874699552376320:12345-0@lo:400:kworker.0 Request processed in 30us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853136.619312:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00080000:3.0:1787853136.619331:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787853136.619376:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f494159da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1874699552376320:0@lo:400:kworker.0 00000100:00100000:3.0:1787853136.619390:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49056ded00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1874699552376192:0@lo:400:kworker.0 00000100:00100000:1.0:1787853136.621734:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853136.621891:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853136.621937:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f494159de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874699552376448:0@lo:400:kworker.0 00000100:00100000:2.0:1787853136.622397:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552375808 00000100:00100000:2.0:1787853136.622409:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552375808 00000100:00100000:2.0:1787853136.622489:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1787853136.622500:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4906230c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d48a955-7010-4118-9c7d-f396984ae1ff+19:3307:x1874699552375808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853136.622611:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4906230c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d48a955-7010-4118-9c7d-f396984ae1ff+19:3307:x1874699552375808:12345-0@lo:400:kworker.0 Request processed in 112us (889us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853136.622620:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1787853136.622697:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4910d10b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5d48a955-7010-4118-9c7d-f396984ae1ff:3307:1874699552375808:0@lo:400:kworker.0 00000100:00100000:2.0:1787853136.622767:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552375936 00000100:00100000:2.0:1787853136.622772:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552375936 00000100:00100000:2.0:1787853136.622802:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1787853136.622809:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4803aacf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874699552375936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853136.622850:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4803aacf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874699552375936:12345-0@lo:400:kworker.0 Request processed in 41us (959us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853136.622857:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1787853136.624656:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853136.624757:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49056dfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874699552375936:0@lo:400:kworker.0 00000100:00100000:1.0:1787853136.627409:0:12025:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552376448 00000100:00100000:1.0:1787853136.627433:0:12025:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552376448 00000100:00100000:1.0:1787853136.627533:0:12025:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787853136.627547:0:12025:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4803aada40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3308:x1874699552376448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853136.627742:0:12025:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4803aada40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3308:x1874699552376448:12345-0@lo:400:kworker.0 Request processed in 198us (3096us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853136.627751:0:12025:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787853136.627886:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f494159de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874699552376448:0@lo:400:kworker.0 00010000:00010000:0.0:1787853136.684738:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787853137.129870:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787853137.129905:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4803aac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874699552376576:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787853137.130010:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853137.130115:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552376576 00000100:00100000:3.0:1787853137.130127:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552376576 00000100:00100000:1.0:1787853137.130166:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4803aacb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552376704:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787853137.130206:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787853137.130210:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853137.130236:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f492eb99a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1874699552376576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787853137.130265:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3856662528 00000100:00100000:2.0:1787853137.130335:0:10348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552376704 00000100:00100000:3.0:1787853137.130356:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f492eb99a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1874699552376576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 137us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853137.130358:0:10348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552376704 00000100:00100000:3.0:1787853137.130393:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787853137.130426:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787853137.130437:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f492eb99e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1874699552376704:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1787853137.130442:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:3.0:1787853137.130469:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787853137.130521:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f492eb99e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1874699552376704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853137.130527:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787853137.130657:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4803aacb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552376704:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787853137.130853:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4803aac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874699552376576:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787853137.707092:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787853138.306522:0:12471:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787853138.306538:0:12471:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787853138.306697:0:12471:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1787853138.306705:0:12471:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787853138.548300:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853138.548395:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526162432 00000100:00100000:3.0:1787853138.548409:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526162432 00000100:00100000:3.0:1787853138.548509:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 187 00000100:00100000:3.0:1787853138.548523:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4803aae1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+22:11549:x1874699526162432:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:3.0:1787853138.548555:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853138.548641:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21800/0x710df789068e6e1e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c507938990c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853138.549016:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20200/0x710df789068e6e25 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853138.549035:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20200/0x710df789068e6e25 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853138.549052:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20200/0x710df789068e6e25 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787853138.549066:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:3.0:1787853138.549294:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21800/0x710df789068e6e1e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c507938990c expref: 25 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853138.549331:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20200/0x710df789068e6e25 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c507938990c expref: 24 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853138.549341:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8f4910f92100) 00010000:00010000:3.0:1787853138.549345:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787853138.549349:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4921e20200, rc 0) 00000100:00100000:3.0:1787853138.549440:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4803aae1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+24:11549:x1874699526162432:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 920us (1155us total) trans 4294967469 rc 0/0 00000100:00100000:3.0:1787853138.549451:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 187 00000100:00080000:0.0:1787853138.550014:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787853138.555760:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853138.556396:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526162560 00000100:00100000:1.0:1787853138.556411:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526162560 00000100:00100000:1.0:1787853138.556483:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 188 00000100:00100000:1.0:1787853138.556493:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4803aaf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+24:11549:x1874699526162560:12345-192.168.204.1@tcp:34:lfs.0 00010000:00010000:1.0:1787853138.556629:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ada00/0x710df789068e6e33 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853138.556654:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ada00/0x710df789068e6e33 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853138.556670:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ada00/0x710df789068e6e33 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853138.556691:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad600/0x710df789068e6e3a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853138.556699:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad600/0x710df789068e6e3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853138.556706:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad600/0x710df789068e6e3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853138.557071:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad000/0x710df789068e6e41 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853138.557080:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad000/0x710df789068e6e41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853138.557098:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad000/0x710df789068e6e41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787853138.557155:0:8462:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad000/0x710df789068e6e41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853138.557169:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ada00/0x710df789068e6e33 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853138.557175:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ada00/0x710df789068e6e33 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853138.557182:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ada00/0x710df789068e6e33 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853138.557188:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f492a8ada00 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:1.0:1787853138.557370:0:8462:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ada00/0x710df789068e6e33 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853138.557382:0:8462:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ada00/0x710df789068e6e33 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853138.557398:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8f4910f92100) 00010000:00010000:1.0:1787853138.557401:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787853138.557407:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ada00/0x710df789068e6e33 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853138.557413:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ada00/0x710df789068e6e33 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853138.557425:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad600/0x710df789068e6e3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853138.557437:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad600/0x710df789068e6e3a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853138.557442:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad600/0x710df789068e6e3a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853138.557447:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f492a8ad600 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:1.0:1787853138.557450:0:8462:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad600/0x710df789068e6e3a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853138.557456:0:8462:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad600/0x710df789068e6e3a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853138.557462:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8f4914d11c00) 00010000:00010000:1.0:1787853138.557464:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787853138.557466:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad600/0x710df789068e6e3a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853138.557471:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad600/0x710df789068e6e3a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853138.557484:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad000/0x710df789068e6e41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853138.557489:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad000/0x710df789068e6e41 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853138.557494:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad000/0x710df789068e6e41 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853138.557498:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f492a8ad000 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:1.0:1787853138.557506:0:8462:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad000/0x710df789068e6e41 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853138.557512:0:8462:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad000/0x710df789068e6e41 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853138.557519:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f4914d11800) 00010000:00010000:1.0:1787853138.557522:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787853138.557525:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad000/0x710df789068e6e41 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853138.557531:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad000/0x710df789068e6e41 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853138.557664:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4803aaf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+24:11549:x1874699526162560:12345-192.168.204.1@tcp:34:lfs.0 Request processed in 1167us (1915us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853138.557675:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 188 00000100:00100000:3.0:1787853138.642133:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853138.642185:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526162816 00000100:00100000:3.0:1787853138.642209:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526162816 00000100:00100000:3.0:1787853138.642288:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 189 00000100:00100000:3.0:1787853138.642300:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493c58f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+24:11552:x1874699526162816:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:3.0:1787853138.643210:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853138.643252:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21800/0x710df789068e6e48 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c5079389913 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853138.643458:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e6e4f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853138.643479:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e6e4f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853138.643494:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e6e4f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853138.643547:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21a00/0x710df789068e6e56 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853138.643556:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21a00/0x710df789068e6e56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853138.643563:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21a00/0x710df789068e6e56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853138.644707:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21c00/0x710df789068e6e5d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853138.644726:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21c00/0x710df789068e6e5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853138.644739:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21c00/0x710df789068e6e5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787853138.644756:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1787853138.645139:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e6e4f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853138.645149:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e6e4f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853138.645156:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e6e4f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853138.645163:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4921e20000 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:3.0:1787853138.645169:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e6e4f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853138.645270:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e6e4f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853138.645289:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8f4910f92100) 00010000:00010000:3.0:1787853138.645292:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787853138.645300:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e6e4f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853138.645307:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e6e4f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853138.645395:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21a00/0x710df789068e6e56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853138.645402:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21a00/0x710df789068e6e56 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853138.645409:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21a00/0x710df789068e6e56 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853138.645414:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4921e21a00 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:3.0:1787853138.645418:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21a00/0x710df789068e6e56 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853138.645425:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21a00/0x710df789068e6e56 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853138.645434:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8f4910f92c00) 00010000:00010000:3.0:1787853138.645437:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787853138.645441:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21a00/0x710df789068e6e56 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853138.645458:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21a00/0x710df789068e6e56 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853138.645530:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21800/0x710df789068e6e48 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389913 expref: 27 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853138.647409:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21c00/0x710df789068e6e5d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389913 expref: 26 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853138.647423:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f4910f92e00) 00010000:00010000:3.0:1787853138.647426:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787853138.647429:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4921e21c00, rc 0) 00000100:00100000:3.0:1787853138.647772:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493c58f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+26:11552:x1874699526162816:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 5470us (5654us total) trans 4294967470 rc 0/0 00000100:00100000:3.0:1787853138.647787:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 189 00000100:00100000:0.0:1787853138.651480:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853138.652213:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526162944 00000100:00100000:2.0:1787853138.652232:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526162944 00000100:00100000:2.0:1787853138.652323:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 190 00000100:00100000:2.0:1787853138.652337:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4803aac3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+26:11552:x1874699526162944:12345-192.168.204.1@tcp:54:lfs.0 00010000:00010000:2.0:1787853138.652457:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9600/0x710df789068e6e6b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853138.652481:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9600/0x710df789068e6e6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853138.652496:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9600/0x710df789068e6e6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853138.652541:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9600/0x710df789068e6e6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853138.652549:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9600/0x710df789068e6e6b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853138.652557:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9600/0x710df789068e6e6b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853138.652566:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b9600 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:2.0:1787853138.652619:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9600/0x710df789068e6e6b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853138.652630:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9600/0x710df789068e6e6b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853138.652647:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f4910f92e00) 00010000:00010000:2.0:1787853138.652651:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787853138.652657:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9600/0x710df789068e6e6b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853138.652665:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9600/0x710df789068e6e6b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853138.652893:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4803aac3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+26:11552:x1874699526162944:12345-192.168.204.1@tcp:54:lfs.0 Request processed in 556us (1429us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853138.652901:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 190 00000100:00100000:0.0:1787853138.656230:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853138.656454:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526163200 00000100:00100000:3.0:1787853138.656467:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526163200 00000100:00100000:3.0:1787853138.656552:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 51 00000100:00100000:3.0:1787853138.656564:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4803aaf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+26:11552:x1874699526163200:12345-192.168.204.1@tcp:35:lfs.0 00000100:00100000:2.0:1787853138.657864:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4803aaf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+27:11552:x1874699526163200:12345-192.168.204.1@tcp:35:lfs.0 Request processed in 1291us (1638us total) trans 4294967471 rc 0/0 00000100:00100000:2.0:1787853138.657877:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 51 00000100:00100000:2.0:1787853138.701306:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853138.702185:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526163456 00000100:00100000:0.0:1787853138.702211:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526163456 00000100:00100000:0.0:1787853138.702290:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 191 00000100:00100000:0.0:1787853138.702304:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f494159de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+27:11078:x1874699526163456:12345-192.168.204.1@tcp:101:bash.0 00010000:00010000:0.0:1787853138.702337:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853138.702366:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6800/0x710df789068e6e72 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c507938991a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853138.702510:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7600/0x710df789068e6e79 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853138.702528:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21c00/0x710df789068e6e5d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389913 expref: 28 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853138.702539:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7600/0x710df789068e6e79 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853138.702624:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21c00/0x710df789068e6e5d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389913 expref: 28 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853138.702641:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21c00/0x710df789068e6e5d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389913 expref: 28 pid: 5837 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853138.702672:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4803aad680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5836:1874699552376832:192.168.204.1@tcp:104: 00000100:00100000:0.0:1787853138.702808:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f4904c00780 going to sleep for 11 seconds 00000100:00100000:2.0:1787853138.712965:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853138.713018:0:11175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526163584 00000100:00100000:2.0:1787853138.713029:0:11175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526163584 00010000:00010000:2.0:1787853138.713087:0:11175:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21c00/0x710df789068e6e5d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389913 expref: 29 pid: 5837 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853138.713135:0:11175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 73 00000100:00100000:2.0:1787853138.713148:0:11175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f494159da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b1d98f5a-0be0-4f69-83a6-833c935c8205+29:2362:x1874699526163584:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787853138.713180:0:11175:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787853138.713196:0:11175:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21c00/0x710df789068e6e5d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389913 expref: 29 pid: 5837 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853138.713214:0:11175:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21c00/0x710df789068e6e5d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389913 expref: 29 pid: 5837 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853138.713246:0:11175:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f4910f92e00) 00010000:00010000:2.0:1787853138.713254:0:11175:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7600/0x710df789068e6e79 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853138.713266:0:11175:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7600/0x710df789068e6e79 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853138.713275:0:11175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7600/0x710df789068e6e79 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853138.713300:0:11175:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787853138.713384:0:11175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f494159da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b1d98f5a-0be0-4f69-83a6-833c935c8205+29:2362:x1874699526163584:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 238us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853138.713395:0:11175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 73 00010000:00010000:0.0:1787853138.713793:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21c00/0x710df789068e6e5d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389913 expref: 28 pid: 5837 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853138.713814:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4803aad680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5836:1874699552376832:192.168.204.1@tcp:104: 00010000:00010000:0.0:1787853138.713838:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7600/0x710df789068e6e79 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853138.713849:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7600/0x710df789068e6e79 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853138.713855:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7600/0x710df789068e6e79 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787853138.713879:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:0.0:1787853138.714082:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6800/0x710df789068e6e72 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c507938991a expref: 29 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853138.714102:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7600/0x710df789068e6e79 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c507938991a expref: 28 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853138.714111:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f4910f92e00) 00010000:00010000:0.0:1787853138.714115:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787853138.714118:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49415b7600, rc 0) 00000100:00100000:0.0:1787853138.714159:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f494159de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+28:11078:x1874699526163456:12345-192.168.204.1@tcp:101:bash.0 Request processed in 11859us (12868us total) trans 4294967472 rc 0/0 00000100:00100000:0.0:1787853138.714179:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 191 00000100:00100000:0.0:1787853138.721168:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853138.721311:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526163840 00000100:00100000:3.0:1787853138.721389:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526163840 00000100:00100000:3.0:1787853138.721469:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 192 00000100:00100000:3.0:1787853138.721481:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4803aad680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+28:11078:x1874699526163840:12345-192.168.204.1@tcp:36:bash.0 00010000:00010000:3.0:1787853138.721875:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21800/0x710df789068e6e87 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853138.721897:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21800/0x710df789068e6e87 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853138.721928:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21800/0x710df789068e6e87 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787853138.721994:0:8462:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:3.0:1787853138.722020:0:8462:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009ff58908 reply state 00000000c8ddc9f3 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21800/0x710df789068e6e87 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853138.722031:0:8462:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1787853138.722081:0:8462:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:3.0:1787853138.722553:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4803aad680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+32:11078:x1874699526163840:12345-192.168.204.1@tcp:36:bash.0 Request processed in 1069us (1398us total) trans 4294967475 rc 0/0 00000100:00100000:3.0:1787853138.722564:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 192 00000020:00080000:3.0:1787853138.722603:0:8462:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:3.0:1787853138.726451:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21800/0x710df789068e6e87 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853138.726480:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21800/0x710df789068e6e87 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853138.726489:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21800/0x710df789068e6e87 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853138.726496:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4921e21800 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:3.0:1787853138.726502:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21800/0x710df789068e6e87 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853138.726511:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21800/0x710df789068e6e87 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853138.726539:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f4910f92e00) 00010000:00010000:3.0:1787853138.726562:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787853138.726600:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21800/0x710df789068e6e87 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853138.726608:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21800/0x710df789068e6e87 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853138.729072:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853138.734773:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526163968 00000100:00100000:2.0:1787853138.734795:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526163968 00000100:00100000:2.0:1787853138.734878:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 193 00000100:00100000:2.0:1787853138.734891:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4803aae940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+31:11078:x1874699526163968:12345-192.168.204.1@tcp:101:bash.0 00010000:00010000:2.0:1787853138.734922:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853138.734956:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8a00/0x710df789068e6e8e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c5079389921 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853138.735076:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8a00/0x710df789068e6e8e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389921 expref: 32 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853138.735096:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8a00/0x710df789068e6e8e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389921 expref: 32 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853138.735122:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f4910f92e00) 00010000:00010000:2.0:1787853138.735126:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787853138.735133:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49415b8a00, rc 0) 00000100:00100000:2.0:1787853138.735262:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4803aae940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+32:11078:x1874699526163968:12345-192.168.204.1@tcp:101:bash.0 Request processed in 373us (6205us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853138.735270:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 193 00010000:00010000:0.0:1787853138.736035:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787853138.738518:0:7641:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000100:00100000:2.0:1787853138.741353:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853138.741505:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526164096 00000100:00100000:3.0:1787853138.741519:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526164096 00000100:00100000:3.0:1787853138.741659:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 60 00000100:00100000:3.0:1787853138.741673:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4910d10b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+7:11078:x1874699526164096:12345-192.168.204.1@tcp:101:bash.0 00010000:00010000:3.0:1787853138.741704:0:8463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853138.741738:0:8463:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a8864ad2/0x710df789068e6e95 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c5079389928 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787853138.741777:0:8463:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a90794e, atime: 0x6a90794c, ctime: 0x6a90794e, blocks: 0xb 00010000:00010000:3.0:1787853138.742026:0:8463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=458s v=(0 0) 00010000:00010000:3.0:1787853138.742033:0:8463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787853138.742044:0:8463:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a8864ad2/0x710df789068e6e95 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389928 expref: 8 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853138.742066:0:8463:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a8864ad2/0x710df789068e6e95 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389928 expref: 8 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853138.742081:0:8463:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4921e21800, rc 0) 00000100:00100000:3.0:1787853138.742390:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4910d10b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+8:11078:x1874699526164096:12345-192.168.204.1@tcp:101:bash.0 Request processed in 719us (1054us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853138.742419:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 60 00000100:00080000:0.0:1787853138.742533:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787853138.745462:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853138.745672:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526164224 00000100:00100000:3.0:1787853138.745685:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526164224 00002000:00010000:3.0:1787853138.745747:0:6687:0:(ofd_dev.c:2831:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:3.0:1787853138.745754:0:6687:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff8f492eb9ad00 with x1874699526164224 ext(0->18446744073709551615) 00002000:00010000:3.0:1787853138.745770:0:6687:0:(ofd_dev.c:2836:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8f492eb9ad00. 00000100:00100000:3.0:1787853138.745808:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 6 00000100:00100000:3.0:1787853138.745821:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f492eb9ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+8:2362:x1874699526164224:12345-192.168.204.1@tcp:10:bash.0 00002000:00010000:3.0:1787853138.746435:0:6687:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1787853138.746441:0:6687:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1787853134 -> 1787853139 00002000:00010000:3.0:1787853138.746444:0:6687:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1787853132 -> 1787853132 00002000:00010000:3.0:1787853138.746446:0:6687:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1787853134 -> 1787853139 00002000:00010000:3.0:1787853138.746449:0:6687:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1787853138.746621:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f492eb9ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+9:2362:x1874699526164224:12345-192.168.204.1@tcp:10:bash.0 Request processed in 799us (1174us total) trans 4294967319 rc 0/0 00000100:00100000:3.0:1787853138.746632:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 6 00002000:00010000:3.0:1787853138.746636:0:6687:0:(ofd_dev.c:2831:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:3.0:1787853138.746639:0:6687:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff8f492eb9ad00 with x1874699526164224 ext(0->18446744073709551615) 00002000:00010000:3.0:1787853138.746646:0:6687:0:(ofd_dev.c:2836:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8f492eb9ad00. 00000100:00100000:2.0:1787853138.765740:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853138.765794:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853138.765896:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526164480 00000100:00100000:0.0:1787853138.765911:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526164480 00000100:00100000:0.0:1787853138.765992:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 61 00000100:00100000:0.0:1787853138.766006:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49056ded00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+9:2364:x1874699526164480:12345-192.168.204.1@tcp:16:kworker.0 00000100:00100000:3.0:1787853138.769056:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526164352 00000100:00100000:3.0:1787853138.769080:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526164352 00002000:00100000:3.0:1787853138.769162:0:6688:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->7) req@ffff8f49056dfc00 x1874699526164352/t0(0) o4->b1d98f5a-0be0-4f69-83a6-833c935c8205@192.168.204.1@tcp:314/0 lens 496/0 e 0 to 0 dl 1787853149 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787853138.769178:0:6688:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff8f49056dfc00 with x1874699526164352 ext(0->7) 00002000:00010000:3.0:1787853138.769186:0:6688:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8f49056dfc00 00000100:00100000:3.0:1787853138.769298:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 7 00000100:00100000:3.0:1787853138.769310:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49056dfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+10:2364:x1874699526164352:12345-192.168.204.1@tcp:4:bash.0 00000100:00100000:3.0:1787853138.769994:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49056dfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+12:2364:x1874699526164352:12345-192.168.204.1@tcp:4:bash.0 Request processed in 682us (4268us total) trans 4294967320 rc 0/0 00000100:00100000:3.0:1787853138.770004:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 7 00002000:00100000:3.0:1787853138.770013:0:6688:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->7) req@ffff8f49056dfc00 x1874699526164352/t4294967320(0) o4->b1d98f5a-0be0-4f69-83a6-833c935c8205@192.168.204.1@tcp:314/0 lens 496/448 e 0 to 0 dl 1787853149 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787853138.770022:0:6688:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff8f49056dfc00 with x1874699526164352 ext(0->7) 00002000:00010000:3.0:1787853138.770026:0:6688:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8f49056dfc00 00000100:00100000:2.0:1787853138.884056:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853138.884428:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526164608 00000100:00100000:3.0:1787853138.884444:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526164608 00000100:00100000:3.0:1787853138.884539:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 194 00000100:00100000:3.0:1787853138.884553:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49056de580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+32:11566:x1874699526164608:12345-192.168.204.1@tcp:34:lfs.0 00010000:00010000:3.0:1787853138.884732:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21a00/0x710df789068e6e9c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853138.884756:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21a00/0x710df789068e6e9c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853138.884772:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21a00/0x710df789068e6e9c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853138.884790:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e6ea3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853138.884798:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e6ea3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853138.884804:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e6ea3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853138.885518:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20400/0x710df789068e6eaa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853138.885531:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20400/0x710df789068e6eaa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853138.885540:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20400/0x710df789068e6eaa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787853138.887508:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967318 is committed 00000001:00080000:3.0:1787853138.887528:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967317 is committed 00000001:00080000:3.0:1787853138.887536:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967319 is committed 00000100:00100000:0.0:1787853138.887884:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49056ded00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+9:2364:x1874699526164480:12345-192.168.204.1@tcp:16:kworker.0 Request processed in 121872us (122079us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853138.887898:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 61 00000004:00010000:1.0:1787853138.891404:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20400/0x710df789068e6eaa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853138.891433:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21a00/0x710df789068e6e9c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853138.891441:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21a00/0x710df789068e6e9c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853138.891449:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21a00/0x710df789068e6e9c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853138.891456:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4921e21a00 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:1.0:1787853138.891462:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21a00/0x710df789068e6e9c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853138.891486:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21a00/0x710df789068e6e9c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853138.891508:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8f4910f92100) 00010000:00010000:1.0:1787853138.891511:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787853138.891517:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21a00/0x710df789068e6e9c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853138.891523:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21a00/0x710df789068e6e9c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853138.891543:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e6ea3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853138.891549:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e6ea3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853138.891555:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e6ea3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853138.891560:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4921e20000 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:1.0:1787853138.891563:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e6ea3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853138.891730:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e6ea3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853138.891739:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8f4910f92600) 00010000:00010000:1.0:1787853138.891741:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787853138.891745:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e6ea3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853138.891761:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e6ea3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853138.891782:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20400/0x710df789068e6eaa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853138.891787:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20400/0x710df789068e6eaa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853138.891792:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20400/0x710df789068e6eaa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853138.891796:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4921e20400 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:1.0:1787853138.891799:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20400/0x710df789068e6eaa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853138.891805:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20400/0x710df789068e6eaa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853138.891814:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f4910f92e00) 00010000:00010000:1.0:1787853138.891815:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787853138.891818:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20400/0x710df789068e6eaa lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853138.891823:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20400/0x710df789068e6eaa lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853138.891952:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49056de580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+32:11566:x1874699526164608:12345-192.168.204.1@tcp:34:lfs.0 Request processed in 7395us (7907us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853138.891965:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 194 00000100:00100000:2.0:1787853138.939652:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853138.940759:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526164864 00000100:00100000:0.0:1787853138.940775:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526164864 00000100:00100000:0.0:1787853138.940860:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 195 00000100:00100000:0.0:1787853138.940870:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493fd54f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+32:11569:x1874699526164864:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:0.0:1787853138.940896:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853138.941023:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6800/0x710df789068e6eb1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c507938992f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853138.941128:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7000/0x710df789068e6eb8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853138.941146:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7000/0x710df789068e6eb8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853138.941159:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7000/0x710df789068e6eb8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853138.941262:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e6ebf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853138.941271:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e6ebf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853138.941278:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e6ebf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853138.946795:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ada00/0x710df789068e6ec6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853138.946823:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ada00/0x710df789068e6ec6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853138.946838:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ada00/0x710df789068e6ec6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787853138.946855:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1787853138.947008:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7000/0x710df789068e6eb8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853138.947017:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7000/0x710df789068e6eb8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853138.947025:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7000/0x710df789068e6eb8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853138.947032:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b7000 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:1.0:1787853138.947038:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7000/0x710df789068e6eb8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853138.947047:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7000/0x710df789068e6eb8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853138.947063:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8f4910f92100) 00010000:00010000:1.0:1787853138.947067:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787853138.947073:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7000/0x710df789068e6eb8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853138.947080:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7000/0x710df789068e6eb8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853138.949123:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e6ebf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853138.949133:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e6ebf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853138.949140:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e6ebf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853138.949148:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b7c00 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:1.0:1787853138.949153:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e6ebf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853138.949161:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e6ebf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853138.949182:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8f491176b600) 00010000:00010000:1.0:1787853138.949379:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787853138.949387:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e6ebf lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853138.949395:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7c00/0x710df789068e6ebf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853138.949484:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6800/0x710df789068e6eb1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c507938992f expref: 35 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853138.949504:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ada00/0x710df789068e6ec6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c507938992f expref: 34 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853138.949526:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f4910f92e00) 00010000:00010000:1.0:1787853138.949529:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787853138.949533:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f492a8ada00, rc 0) 00000100:00100000:1.0:1787853138.949750:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493fd54f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+34:11569:x1874699526164864:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 8880us (10191us total) trans 4294967476 rc 0/0 00000100:00100000:1.0:1787853138.949759:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 195 00000100:00100000:0.0:1787853138.959826:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853138.959933:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526164992 00000100:00100000:1.0:1787853138.959947:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526164992 00000100:00100000:1.0:1787853138.960026:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 196 00000100:00100000:1.0:1787853138.960040:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4803aac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+34:11569:x1874699526164992:12345-192.168.204.1@tcp:54:lfs.0 00010000:00010000:1.0:1787853138.960147:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad600/0x710df789068e6ed4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853138.960179:0:8462:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7600/0x710df789068e6e79 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c507938991a expref: 34 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853138.960199:0:8462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad600/0x710df789068e6ed4 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853138.960247:0:8462:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7600/0x710df789068e6e79 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.1@tcp remote: 0xd0a9c507938991a expref: 34 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853138.960266:0:8462:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7600/0x710df789068e6e79 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c507938991a expref: 34 pid: 5836 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853138.960285:0:8462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f492eb9b480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8462:1874699552376960:192.168.204.1@tcp:104: 00000100:00100000:1.0:1787853138.961368:0:8462:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f4905074e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787853138.963805:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853138.964133:0:8462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f492eb9b480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8462:1874699552376960:192.168.204.1@tcp:104: 00010000:00010000:1.0:1787853138.964164:0:8462:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad600/0x710df789068e6ed4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853138.964679:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526165248 00000100:00100000:0.0:1787853138.964690:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526165248 00000100:00100000:0.0:1787853138.964806:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 52 00000100:00100000:0.0:1787853138.964819:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493c58f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+35:5607:x1874699526165248:12345-192.168.204.1@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787853138.965305:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493c58f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+36:5607:x1874699526165248:12345-192.168.204.1@tcp:35:ldlm_bl.0 Request processed in 486us (1513us total) trans 4294967477 rc 0/0 00000100:00100000:0.0:1787853138.965383:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 52 00000100:00100000:3.0:1787853138.967542:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853138.967701:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526165376 00000100:00100000:1.0:1787853138.967714:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526165376 00010000:00010000:1.0:1787853138.967766:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7600/0x710df789068e6e79 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c507938991a expref: 36 pid: 5836 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853138.967805:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 74 00000100:00100000:1.0:1787853138.967815:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493c58c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+36:2363:x1874699526165376:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787853138.967832:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787853138.967839:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7600/0x710df789068e6e79 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c507938991a expref: 36 pid: 5836 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853138.967853:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7600/0x710df789068e6e79 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c507938991a expref: 36 pid: 5836 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853138.967880:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7600/0x710df789068e6e79 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c507938991a expref: 36 pid: 5836 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853138.967901:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f4910f92e00) 00010000:00010000:1.0:1787853138.967907:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad600/0x710df789068e6ed4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853138.967918:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad600/0x710df789068e6ed4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853138.967948:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad600/0x710df789068e6ed4 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853138.967976:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787853138.968040:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493c58c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+35:2363:x1874699526165376:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 227us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853138.968048:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 74 00010000:00010000:1.0:1787853138.968077:0:8462:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad600/0x710df789068e6ed4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853138.968100:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad600/0x710df789068e6ed4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853138.968137:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad600/0x710df789068e6ed4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853138.968144:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad600/0x710df789068e6ed4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853138.968151:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad600/0x710df789068e6ed4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853138.968157:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f492a8ad600 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:1.0:1787853138.968163:0:8462:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad600/0x710df789068e6ed4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853138.968170:0:8462:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad600/0x710df789068e6ed4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853138.968180:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f4910f92e00) 00010000:00010000:1.0:1787853138.968183:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787853138.968406:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad600/0x710df789068e6ed4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853138.968413:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad600/0x710df789068e6ed4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853138.968465:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4803aac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+34:11569:x1874699526164992:12345-192.168.204.1@tcp:54:lfs.0 Request processed in 8428us (8655us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853138.968475:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 196 00000100:00100000:1.0:1787853138.971392:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853138.971913:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526165632 00000100:00100000:2.0:1787853138.971930:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526165632 00000100:00100000:2.0:1787853138.972011:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 53 00000100:00100000:2.0:1787853138.972023:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f492eb9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+34:11569:x1874699526165632:12345-192.168.204.1@tcp:35:lfs.0 00000100:00100000:2.0:1787853138.972703:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f492eb9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+35:11569:x1874699526165632:12345-192.168.204.1@tcp:35:lfs.0 Request processed in 678us (1324us total) trans 4294967478 rc 0/0 00000100:00100000:2.0:1787853138.972713:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 53 00000100:00100000:3.0:1787853139.082735:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853139.082871:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526165888 00000100:00100000:2.0:1787853139.082902:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526165888 00000100:00100000:2.0:1787853139.082980:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 197 00000100:00100000:2.0:1787853139.082992:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493c58da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+35:11580:x1874699526165888:12345-192.168.204.1@tcp:101:cat.0 00010000:00010000:2.0:1787853139.083025:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853139.083059:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9e00/0x710df789068e6edb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c5079389936 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853139.083164:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e6ee2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853139.083182:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e6ee2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853139.083270:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e6ee2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853139.083289:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8800/0x710df789068e6ee9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853139.083297:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8800/0x710df789068e6ee9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853139.083304:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8800/0x710df789068e6ee9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853139.083985:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8600/0x710df789068e6ef0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853139.084000:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8600/0x710df789068e6ef0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853139.084009:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8600/0x710df789068e6ef0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787853139.084029:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:2.0:1787853139.084152:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e6ee2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853139.084161:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e6ee2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853139.084168:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e6ee2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853139.084176:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b8c00 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:2.0:1787853139.084181:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e6ee2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853139.085153:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e6ee2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853139.085173:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8f4910f92100) 00010000:00010000:2.0:1787853139.085176:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787853139.085260:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e6ee2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853139.085270:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e6ee2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853139.085292:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8800/0x710df789068e6ee9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853139.085298:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8800/0x710df789068e6ee9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853139.085385:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8800/0x710df789068e6ee9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853139.085391:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b8800 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:2.0:1787853139.085395:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8800/0x710df789068e6ee9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853139.085402:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8800/0x710df789068e6ee9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853139.085411:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8f4910aab500) 00010000:00010000:2.0:1787853139.085414:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787853139.085417:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8800/0x710df789068e6ee9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853139.085423:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8800/0x710df789068e6ee9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853139.085499:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9e00/0x710df789068e6edb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389936 expref: 38 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853139.085516:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8600/0x710df789068e6ef0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389936 expref: 37 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853139.085522:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f4910f92e00) 00010000:00010000:2.0:1787853139.085525:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787853139.085527:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49415b8600, rc 0) 00000100:00100000:2.0:1787853139.085750:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493c58da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+37:11580:x1874699526165888:12345-192.168.204.1@tcp:101:cat.0 Request processed in 2758us (3029us total) trans 4294967479 rc 0/0 00000100:00100000:2.0:1787853139.085770:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 197 00000100:00100000:3.0:1787853139.092440:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853139.092531:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526166144 00000100:00100000:2.0:1787853139.092543:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526166144 00000100:00100000:2.0:1787853139.092643:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 54 00000100:00100000:2.0:1787853139.092654:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493c58f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+37:11580:x1874699526166144:12345-192.168.204.1@tcp:35:cat.0 00000100:00100000:2.0:1787853139.092969:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493c58f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+38:11580:x1874699526166144:12345-192.168.204.1@tcp:35:cat.0 Request processed in 316us (542us total) trans 4294967480 rc 0/0 00000100:00100000:2.0:1787853139.092977:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 54 00000100:00100000:1.0:1787853139.126104:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853139.126317:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526166400 00000100:00100000:0.0:1787853139.126331:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526166400 00000100:00100000:0.0:1787853139.126410:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 198 00000100:00100000:0.0:1787853139.126422:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f492eb9bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+38:11581:x1874699526166400:12345-192.168.204.1@tcp:36:rm.0 00010000:00010000:0.0:1787853139.126502:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787853139.126551:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8600/0x710df789068e6ef0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389936 expref: 38 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.126649:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ada00/0x710df789068e6ec6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c507938992f expref: 37 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.126690:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8a00/0x710df789068e6e8e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389921 expref: 36 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.126702:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f4910f92e00) 00010000:00010000:0.0:1787853139.126715:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787853139.126745:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e6efe lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.126761:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e6efe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.126773:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e6efe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.126789:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6600/0x710df789068e6f05 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.126796:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6600/0x710df789068e6f05 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.126802:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6600/0x710df789068e6f05 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.127434:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7800/0x710df789068e6f0c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.127448:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7800/0x710df789068e6f0c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.127456:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7800/0x710df789068e6f0c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787853139.129506:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:0.0:1787853139.129523:0:5838:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 458670951654ns, next at 459670948589ns, rc = 0 00010000:00010000:0.0:1787853139.130735:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7200/0x710df789068e6f13 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.130758:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7200/0x710df789068e6f13 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.130774:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7200/0x710df789068e6f13 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.130785:0:5838:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7200/0x710df789068e6f13 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.130793:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7200/0x710df789068e6f13 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.130799:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7200/0x710df789068e6f13 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.130887:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787853139.130931:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7800/0x710df789068e6f0c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.130938:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7800/0x710df789068e6f0c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.130945:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7800/0x710df789068e6f0c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.130953:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b7800 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:0.0:1787853139.130970:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7800/0x710df789068e6f0c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.130980:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7800/0x710df789068e6f0c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.130995:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f491176b100) 00010000:00010000:0.0:1787853139.130998:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787853139.131004:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7800/0x710df789068e6f0c lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.131012:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7800/0x710df789068e6f0c lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.131038:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e6efe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.131046:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e6efe lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.131053:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e6efe lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.131058:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b6200 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:0.0:1787853139.131061:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e6efe lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.131067:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e6efe lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.131074:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8f4910f92100) 00010000:00010000:0.0:1787853139.131077:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787853139.131089:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e6efe lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.131096:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e6efe lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787853139.131110:0:5838:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000042f25a6b reply state 000000002f6320c0 transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6600/0x710df789068e6f05 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853139.131121:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787853139.131490:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f492eb9bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+37:11581:x1874699526166400:12345-192.168.204.1@tcp:36:rm.0 Request processed in 5059us (5392us total) trans 4294967481 rc 0/0 00000100:00100000:0.0:1787853139.131502:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 198 00010000:00010000:3.0:1787853139.132148:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787853139.132162:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7200/0x710df789068e6f13 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853139.132174:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b7200 already unused, calling callback (ffffffffc1528440) 00010000:00010000:3.0:1787853139.132178:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7200/0x710df789068e6f13 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853139.132273:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7200/0x710df789068e6f13 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853139.132293:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f491176b100) 00010000:00010000:3.0:1787853139.132297:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787853139.132301:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7200/0x710df789068e6f13 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853139.132389:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7200/0x710df789068e6f13 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853139.132415:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787853139.132418:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787853139.132419:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853139.161319:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6600/0x710df789068e6f05 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.161344:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6600/0x710df789068e6f05 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.161353:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6600/0x710df789068e6f05 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.161362:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b6600 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:0.0:1787853139.161369:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6600/0x710df789068e6f05 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.161379:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6600/0x710df789068e6f05 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.161403:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8f491176bf00) 00010000:00010000:0.0:1787853139.161406:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787853139.161413:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6600/0x710df789068e6f05 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.161441:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6600/0x710df789068e6f05 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853139.205289:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853139.206037:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526166656 00000100:00100000:2.0:1787853139.206050:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526166656 00000100:00100000:2.0:1787853139.206130:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 199 00000100:00100000:2.0:1787853139.206142:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f492eb98780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+36:11587:x1874699526166656:12345-192.168.204.1@tcp:101:bash.0 00010000:00010000:2.0:1787853139.206174:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853139.206213:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8800/0x710df789068e6f1a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c507938993d expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853139.206403:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e6f21 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853139.206422:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e6f21 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853139.206435:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e6f21 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853139.206451:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8200/0x710df789068e6f28 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853139.206478:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8200/0x710df789068e6f28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853139.206485:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8200/0x710df789068e6f28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787853139.207880:0:5837:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:2.0:1787853139.209996:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8000/0x710df789068e6f2f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853139.210029:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8000/0x710df789068e6f2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853139.210047:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8000/0x710df789068e6f2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853139.210105:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e6f21 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853139.210113:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e6f21 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853139.210120:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e6f21 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853139.210128:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b8c00 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:2.0:1787853139.210133:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e6f21 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853139.210141:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e6f21 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853139.210179:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8f4910f92100) 00010000:00010000:2.0:1787853139.210193:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787853139.210199:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e6f21 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853139.210207:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e6f21 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787853139.210226:0:5837:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000d12cbdf reply state 00000000594133e5 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8200/0x710df789068e6f28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853139.210237:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787853139.210287:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8800/0x710df789068e6f1a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c507938993d expref: 39 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853139.210303:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8000/0x710df789068e6f2f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c507938993d expref: 38 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853139.210324:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8f4910aab900) 00010000:00010000:2.0:1787853139.210327:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787853139.210329:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49415b8000, rc 0) 00000100:00100000:2.0:1787853139.210442:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f492eb98780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+39:11587:x1874699526166656:12345-192.168.204.1@tcp:101:bash.0 Request processed in 4301us (5169us total) trans 4294967482 rc 0/0 00000100:00100000:2.0:1787853139.210453:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 199 00010000:00010000:3.0:1787853139.213212:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8200/0x710df789068e6f28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853139.213239:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8200/0x710df789068e6f28 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853139.213249:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8200/0x710df789068e6f28 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853139.213256:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b8200 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:3.0:1787853139.213263:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8200/0x710df789068e6f28 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853139.213271:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8200/0x710df789068e6f28 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853139.213296:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8f4910aab500) 00010000:00010000:3.0:1787853139.213299:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787853139.213305:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8200/0x710df789068e6f28 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853139.213323:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8200/0x710df789068e6f28 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853139.217365:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853139.217463:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526166784 00000100:00100000:3.0:1787853139.217493:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526166784 00000100:00100000:3.0:1787853139.217639:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 62 00000100:00100000:3.0:1787853139.217653:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f492eb992c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+5:2364:x1874699526166784:12345-192.168.204.1@tcp:101:bash.0 00010000:00010000:3.0:1787853139.217679:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853139.217711:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003fa2ba9a/0x710df789068e6f3d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c5079389944 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787853139.217748:0:6681:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787853139.217775:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=458s v=(0 0) 00010000:00010000:3.0:1787853139.217780:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787853139.217793:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003fa2ba9a/0x710df789068e6f3d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389944 expref: 6 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853139.217819:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003fa2ba9a/0x710df789068e6f3d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389944 expref: 6 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853139.217835:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4921e20c00, rc 0) 00000100:00100000:3.0:1787853139.217912:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f492eb992c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+6:2364:x1874699526166784:12345-192.168.204.1@tcp:101:bash.0 Request processed in 263us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853139.217920:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 62 00000100:00080000:0.0:1787853139.218074:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787853139.221191:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853139.221287:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526166912 00000100:00100000:3.0:1787853139.221300:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526166912 00000100:00100000:3.0:1787853139.221382:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 63 00000100:00100000:3.0:1787853139.221393:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f492eb98f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+6:11587:x1874699526166912:12345-192.168.204.1@tcp:101:bash.0 00010000:00010000:3.0:1787853139.221416:0:8463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853139.221442:0:8463:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d7ed99ec/0x710df789068e6f44 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c507938994b expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853139.221559:0:8463:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003fa2ba9a/0x710df789068e6f3d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389944 expref: 7 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853139.221621:0:8463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787853139.221627:0:8463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787853139.221634:0:8463:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d7ed99ec/0x710df789068e6f44 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c507938994b expref: 7 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853139.221679:0:8463:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003fa2ba9a/0x710df789068e6f3d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389944 expref: 7 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853139.221694:0:8463:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003fa2ba9a/0x710df789068e6f3d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389944 expref: 7 pid: 6681 timeout: 558 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853139.221711:0:8463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4908ca4f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8463:1874699552377088:192.168.204.1@tcp:104: 00000100:00100000:3.0:1787853139.221837:0:8463:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f493480dd80 going to sleep for 11 seconds 00000100:00100000:3.0:1787853139.224670:0:8463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4908ca4f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8463:1874699552377088:192.168.204.1@tcp:104: 00010000:00010000:3.0:1787853139.224720:0:8463:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d7ed99ec/0x710df789068e6f44 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.1@tcp remote: 0xd0a9c507938994b expref: 7 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853139.224746:0:8463:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4921e20400, rc 0) 00000100:00100000:3.0:1787853139.224827:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f492eb98f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+7:11587:x1874699526166912:12345-192.168.204.1@tcp:101:bash.0 Request processed in 3434us (3658us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853139.224838:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 63 00000100:00100000:0.0:1787853139.226197:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853139.226315:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526167040 00000100:00100000:2.0:1787853139.226329:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526167040 00010000:00010000:2.0:1787853139.226383:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003fa2ba9a/0x710df789068e6f3d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389944 expref: 7 pid: 6681 timeout: 558 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853139.226456:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 75 00000100:00100000:2.0:1787853139.226466:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4803aacb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+7:2362:x1874699526167040:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787853139.226485:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787853139.226522:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003fa2ba9a/0x710df789068e6f3d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389944 expref: 7 pid: 6681 timeout: 558 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853139.226549:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003fa2ba9a/0x710df789068e6f3d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389944 expref: 7 pid: 6681 timeout: 558 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853139.226612:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003fa2ba9a/0x710df789068e6f3d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389944 expref: 7 pid: 6681 timeout: 558 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853139.226633:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787853139.226637:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787853139.226646:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d7ed99ec/0x710df789068e6f44 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.1@tcp remote: 0xd0a9c507938994b expref: 6 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853139.226658:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d7ed99ec/0x710df789068e6f44 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.1@tcp remote: 0xd0a9c507938994b expref: 6 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853139.226706:0:5823:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d7ed99ec/0x710df789068e6f44 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.1@tcp remote: 0xd0a9c507938994b expref: 6 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853139.226724:0:5823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4941742940 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5823:1874699552377216:192.168.204.1@tcp:105: 00000100:00100000:2.0:1787853139.226828:0:5823:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f490664aa80 going to sleep for 11 seconds 00000100:00100000:1.0:1787853139.232094:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853139.233322:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526167296 00000100:00100000:3.0:1787853139.233338:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526167296 00000100:00100000:3.0:1787853139.233401:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 55 00000100:00100000:3.0:1787853139.233411:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f492eb9a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+38:11587:x1874699526167296:12345-192.168.204.1@tcp:35:bash.0 00000100:00100000:3.0:1787853139.233895:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f492eb9a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+39:11587:x1874699526167296:12345-192.168.204.1@tcp:35:bash.0 Request processed in 482us (1813us total) trans 4294967483 rc 0/0 00000100:00100000:3.0:1787853139.233904:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 55 00000100:00100000:2.0:1787853139.236152:0:5823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4941742940 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5823:1874699552377216:192.168.204.1@tcp:105: 00010000:00010000:2.0:1787853139.236201:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787853139.236297:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4803aacb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+6:2362:x1874699526167040:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 9829us (10118us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853139.236319:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 75 00000100:00100000:1.0:1787853139.301154:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853139.301233:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853139.301351:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526167424 00000100:00100000:0.0:1787853139.301366:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526167424 00000100:00100000:0.0:1787853139.301455:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 306 00000100:00100000:0.0:1787853139.301468:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4906233050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af755b38-4932-400a-92cc-ddad0ca077a5+13:2362:x1874699526167424:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:0.0:1787853139.301643:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4906233050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af755b38-4932-400a-92cc-ddad0ca077a5+13:2362:x1874699526167424:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 177us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853139.301652:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 306 00000100:00100000:2.0:1787853139.302002:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526167552 00000100:00100000:2.0:1787853139.302009:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526167552 00000100:00100000:2.0:1787853139.302081:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 177 00000100:00100000:2.0:1787853139.302091:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f492eb98b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ea3b4e1-e827-460f-be07-19e86dff3d79+5:2363:x1874699526167552:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:2.0:1787853139.302143:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f492eb98b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ea3b4e1-e827-460f-be07-19e86dff3d79+5:2363:x1874699526167552:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 55us (1006us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853139.302151:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 177 00000100:00080000:0.0:1787853139.302975:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787853139.432784:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853139.432916:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526167680 00000100:00100000:0.0:1787853139.432938:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526167680 00000100:00100000:0.0:1787853139.433013:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 200 00000100:00100000:0.0:1787853139.433026:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f492eb9a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+39:11603:x1874699526167680:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:0.0:1787853139.433060:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853139.433103:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e6f4b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c5079389952 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.433213:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7800/0x710df789068e6f52 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.433232:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7800/0x710df789068e6f52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.433249:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7800/0x710df789068e6f52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787853139.433362:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:0.0:1787853139.433366:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787853139.433403:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7800/0x710df789068e6f52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.433436:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e6f4b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389952 expref: 41 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.433461:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7800/0x710df789068e6f52 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389952 expref: 40 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.433470:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8f4910f92100) 00010000:00010000:0.0:1787853139.433473:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787853139.433476:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49415b7800, rc 0) 00000100:00100000:0.0:1787853139.433561:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f492eb9a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+40:11603:x1874699526167680:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 539us (796us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853139.433643:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 200 00000100:00100000:1.0:1787853139.441230:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853139.441347:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526167936 00000100:00100000:2.0:1787853139.441361:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526167936 00000100:00100000:2.0:1787853139.441442:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 201 00000100:00100000:2.0:1787853139.441456:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493fdd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+40:11603:x1874699526167936:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:2.0:1787853139.441484:0:8462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853139.441531:0:8462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8800/0x710df789068e6f59 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c5079389959 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853139.441742:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e6f60 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853139.441762:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e6f60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853139.441805:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e6f60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787853139.441820:0:8462:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1787853139.442002:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8800/0x710df789068e6f59 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389959 expref: 43 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853139.442027:0:8462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e6f60 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389959 expref: 42 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853139.442038:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8f4910aab900) 00010000:00010000:2.0:1787853139.442042:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787853139.442047:0:8462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49415b8c00, rc 0) 00000100:00100000:2.0:1787853139.442160:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493fdd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+42:11603:x1874699526167936:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 707us (946us total) trans 4294967484 rc 0/0 00000100:00100000:2.0:1787853139.442169:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 201 00000100:00100000:3.0:1787853139.449454:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853139.449634:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853139.449714:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526168320 00000100:00100000:0.0:1787853139.449728:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526168320 00000100:00100000:0.0:1787853139.449812:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 202 00000100:00100000:0.0:1787853139.449824:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4908ca4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+42:11603:x1874699526168320:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:0.0:1787853139.449860:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853139.449887:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e6f6e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c5079389960 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.450063:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6400/0x710df789068e6f75 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.450093:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6400/0x710df789068e6f75 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.450111:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6400/0x710df789068e6f75 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787853139.450128:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1787853139.450299:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6200/0x710df789068e6f6e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389960 expref: 45 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.450324:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6400/0x710df789068e6f75 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389960 expref: 44 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.450336:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8f4910aab900) 00010000:00010000:0.0:1787853139.450339:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787853139.450344:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49415b6400, rc 0) 00000100:00100000:0.0:1787853139.450440:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4908ca4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+44:11603:x1874699526168320:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 618us (805us total) trans 4294967485 rc 0/0 00000100:00100000:0.0:1787853139.450448:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 202 00000100:00100000:2.0:1787853139.450730:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526168064 00000100:00100000:2.0:1787853139.450739:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526168064 00000100:00100000:2.0:1787853139.450783:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 14 00000100:00100000:2.0:1787853139.450793:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4905685850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+44:2362:x1874699526168064:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787853139.450806:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787853139.450825:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e6f60 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389959 expref: 44 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853139.450837:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8f4910aab900) 00010000:00010000:2.0:1787853139.450840:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787853139.450874:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4905685850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+43:2362:x1874699526168064:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 83us (1437us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853139.450881:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 14 00000100:00100000:1.0:1787853139.462811:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853139.462934:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526168448 00000100:00100000:0.0:1787853139.462949:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526168448 00000100:00100000:0.0:1787853139.463034:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 64 00000100:00100000:0.0:1787853139.463050:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493fdd4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+6:2365:x1874699526168448:12345-192.168.204.1@tcp:1:lfs.0 00010000:00010000:0.0:1787853139.463122:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000992a9954/0x710df789068e6f83 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.463148:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d7ed99ec/0x710df789068e6f44 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.1@tcp remote: 0xd0a9c507938994b expref: 6 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.463182:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1787853139.463193:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787853139.463198:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000992a9954/0x710df789068e6f83 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.463241:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d7ed99ec/0x710df789068e6f44 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.1@tcp remote: 0xd0a9c507938994b expref: 6 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.463256:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d7ed99ec/0x710df789068e6f44 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.1@tcp remote: 0xd0a9c507938994b expref: 6 pid: 8463 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853139.463274:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4803aad2c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6682:1874699552377344:192.168.204.1@tcp:104: 00000100:00100000:0.0:1787853139.465646:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f4904c00180 going to sleep for 11 seconds 00000100:00100000:1.0:1787853139.466770:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853139.466887:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526168576 00000100:00100000:2.0:1787853139.466900:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526168576 00002000:00100000:2.0:1787853139.466972:0:6689:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff8f493fdd7840 x1874699526168576/t0(0) o4->b1d98f5a-0be0-4f69-83a6-833c935c8205@192.168.204.1@tcp:315/0 lens 504/0 e 0 to 0 dl 1787853150 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787853139.466986:0:6689:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff8f493fdd7840 with x1874699526168576 ext(0->8) 00010000:00010000:2.0:1787853139.466997:0:6689:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000d7ed99ec/0x710df789068e6f44 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.1@tcp remote: 0xd0a9c507938994b expref: 7 pid: 8463 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853139.467018:0:6689:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000d7ed99ec/0x710df789068e6f44 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.1@tcp remote: 0xd0a9c507938994b expref: 7 pid: 8463 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787853139.467027:0:6689:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8f493fdd7840 00000100:00100000:2.0:1787853139.467067:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 3 00000100:00100000:2.0:1787853139.467079:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493fdd7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+7:2363:x1874699526168576:12345-192.168.204.1@tcp:4:lfs.0 00000100:00100000:3.0:1787853139.470811:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493fdd7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+9:2363:x1874699526168576:12345-192.168.204.1@tcp:4:lfs.0 Request processed in 3714us (4034us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1787853139.470843:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 3 00002000:00100000:3.0:1787853139.470862:0:6689:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff8f493fdd7840 x1874699526168576/t4294967308(0) o4->b1d98f5a-0be0-4f69-83a6-833c935c8205@192.168.204.1@tcp:315/0 lens 504/448 e 0 to 0 dl 1787853150 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787853139.470875:0:6689:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff8f493fdd7840 with x1874699526168576 ext(0->8) 00010000:00010000:3.0:1787853139.470888:0:6689:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000d7ed99ec/0x710df789068e6f44 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.1@tcp remote: 0xd0a9c507938994b expref: 9 pid: 8463 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853139.470914:0:6689:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000d7ed99ec/0x710df789068e6f44 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.1@tcp remote: 0xd0a9c507938994b expref: 9 pid: 8463 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787853139.470923:0:6689:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8f493fdd7840 00000100:00100000:0.0:1787853139.473028:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4803aad2c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6682:1874699552377344:192.168.204.1@tcp:104: 00010000:00010000:0.0:1787853139.473072:0:6682:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000992a9954/0x710df789068e6f83 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853139.474011:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853139.474119:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526168704 00000100:00100000:3.0:1787853139.474131:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526168704 00010000:00010000:3.0:1787853139.474205:0:8450:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d7ed99ec/0x710df789068e6f44 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.1@tcp remote: 0xd0a9c507938994b expref: 9 pid: 8463 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853139.474274:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 76 00000100:00100000:3.0:1787853139.474286:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4904cd6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+9:2363:x1874699526168704:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787853139.474317:0:8450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1787853139.474345:0:8450:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1787853139.474349:0:8450:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787853139 00002000:00010000:3.0:1787853139.474352:0:8450:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787853139 00002000:00010000:3.0:1787853139.474355:0:8450:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1787853139 00010000:00010000:3.0:1787853139.474362:0:8450:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d7ed99ec/0x710df789068e6f44 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.1@tcp remote: 0xd0a9c507938994b expref: 9 pid: 8463 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853139.474378:0:8450:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d7ed99ec/0x710df789068e6f44 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.1@tcp remote: 0xd0a9c507938994b expref: 9 pid: 8463 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853139.474412:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d7ed99ec/0x710df789068e6f44 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.1@tcp remote: 0xd0a9c507938994b expref: 9 pid: 8463 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853139.474433:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787853139.474438:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787853139.474445:0:8450:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000992a9954/0x710df789068e6f83 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853139.474456:0:8450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000992a9954/0x710df789068e6f83 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853139.474504:0:8450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787853139.474689:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4904cd6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+8:2363:x1874699526168704:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 405us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853139.474698:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 76 00010000:00010000:2.0:1787853139.474922:0:6682:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000992a9954/0x710df789068e6f83 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853139.474934:0:6682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000992a9954/0x710df789068e6f83 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853139.474967:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000992a9954/0x710df789068e6f83 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853139.474991:0:6682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000992a9954/0x710df789068e6f83 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853139.475001:0:6682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000992a9954/0x710df789068e6f83 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853139.475009:0:6682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b6200 already unused, calling callback (ffffffffc1528440) 00010000:00010000:2.0:1787853139.475015:0:6682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000992a9954/0x710df789068e6f83 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853139.475025:0:6682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000992a9954/0x710df789068e6f83 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853139.475039:0:6682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000992a9954/0x710df789068e6f83 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853139.475046:0:6682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000992a9954/0x710df789068e6f83 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853139.475122:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493fdd4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+7:2365:x1874699526168448:12345-192.168.204.1@tcp:1:lfs.0 Request processed in 12079us (12330us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853139.475132:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 64 00000100:00100000:1.0:1787853139.482894:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853139.485999:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526168960 00000100:00100000:3.0:1787853139.486022:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526168960 00000100:00100000:3.0:1787853139.486425:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 56 00000100:00100000:3.0:1787853139.486443:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4910408050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+43:11603:x1874699526168960:12345-192.168.204.1@tcp:35:lfs.0 00000004:00010000:3.0:1787853139.486532:0:5839:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6400/0x710df789068e6f75 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389960 expref: 43 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787853139.486899:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:3.0:1787853139.486968:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:3.0:1787853139.487704:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:3.0:1787853139.487783:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20400/0x710df789068e6f8a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853139.487808:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8000/0x710df789068e6f2f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c507938993d expref: 47 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853139.487820:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20400/0x710df789068e6f8a lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853139.487873:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8000/0x710df789068e6f2f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.1@tcp remote: 0xd0a9c507938993d expref: 47 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853139.487895:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8000/0x710df789068e6f2f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c507938993d expref: 47 pid: 5837 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853139.487913:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4908ca5a40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5839:1874699552377472:192.168.204.1@tcp:104: 00000100:00100000:3.0:1787853139.488061:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f493480dd80 going to sleep for 11 seconds 00000100:00100000:1.0:1787853139.493121:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853139.493992:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526169088 00000100:00100000:0.0:1787853139.494008:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526169088 00010000:00010000:0.0:1787853139.494069:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8000/0x710df789068e6f2f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c507938993d expref: 48 pid: 5837 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853139.494124:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 77 00000100:00100000:0.0:1787853139.494136:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49418a1680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+48:2362:x1874699526169088:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787853139.494190:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787853139.494199:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8000/0x710df789068e6f2f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c507938993d expref: 48 pid: 5837 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.494214:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8000/0x710df789068e6f2f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c507938993d expref: 48 pid: 5837 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.494246:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8f4910aab900) 00010000:00010000:0.0:1787853139.494254:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20400/0x710df789068e6f8a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.494265:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20400/0x710df789068e6f8a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.494273:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20400/0x710df789068e6f8a lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.494298:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787853139.494389:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49418a1680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+48:2362:x1874699526169088:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 255us (1287us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853139.494398:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 77 00010000:00010000:2.0:1787853139.500970:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8000/0x710df789068e6f2f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c507938993d expref: 47 pid: 5837 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853139.501036:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4908ca5a40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5839:1874699552377472:192.168.204.1@tcp:104: 00010000:00010000:2.0:1787853139.501070:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20400/0x710df789068e6f8a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853139.501083:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20400/0x710df789068e6f8a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853139.501090:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20400/0x710df789068e6f8a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787853139.501281:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:2.0:1787853139.501978:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:2.0:1787853139.502827:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4941742940 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5839:1874699552377600:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787853139.502934:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853139.502992:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f490573bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787853139.503331:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552377600 00000100:00100000:0.0:1787853139.503342:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552377600 00000100:00100000:0.0:1787853139.503448:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787853139.503461:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49056dad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5839:x1874699552377600:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787853139.503631:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49056dad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5839:x1874699552377600:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 172us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853139.503640:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787853139.504031:0:5839:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:1.0:1787853139.504040:0:5839:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8f492eb9b0c0, transno 4294967307 00000100:00100000:1.0:1787853139.504055:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4941742940 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5839:1874699552377600:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1787853139.504714:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:1.0:1787853139.504818:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49418a1e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5839:1874699552377728:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787853139.504892:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853139.504927:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f4905074180 going to sleep for 11 seconds 00000100:00100000:3.0:1787853139.505182:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552377728 00000100:00100000:3.0:1787853139.505192:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552377728 00000100:00100000:3.0:1787853139.505254:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787853139.505267:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49418a12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5839:x1874699552377728:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787853139.505544:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49418a12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5839:x1874699552377728:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 280us (651us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1787853139.505553:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:2.0:1787853139.506144:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787853139.508082:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49418a1e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5839:1874699552377728:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1787853139.508711:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:1.0:1787853139.508793:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20400/0x710df789068e6f8a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853139.508807:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20400/0x710df789068e6f8a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853139.508815:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20400/0x710df789068e6f8a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853139.508823:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4921e20400 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:1.0:1787853139.508829:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20400/0x710df789068e6f8a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853139.508839:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20400/0x710df789068e6f8a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853139.508862:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8f4910aab900) 00010000:00010000:1.0:1787853139.508866:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787853139.508872:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20400/0x710df789068e6f8a lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853139.508879:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20400/0x710df789068e6f8a lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787853139.509148:0:5839:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1787853139.511948:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:1.0:1787853139.511979:0:5839:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 459053407945ns, next at 460053402183ns, rc = 0 00000001:00080000:1.0:1787853139.512014:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:1.0:1787853139.512100:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8f4910aab900) 00010000:00010000:1.0:1787853139.512106:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787853139.512122:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6400/0x710df789068e6f75 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389960 expref: 51 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853139.513117:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4910408050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+50:11603:x1874699526168960:12345-192.168.204.1@tcp:35:lfs.0 Request processed in 26670us (30232us total) trans 4294967494 rc 0/0 00000100:00100000:1.0:1787853139.513133:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 56 00000020:00080000:1.0:1787853139.513142:0:5839:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1787853139.520014:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853139.520090:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526169216 00000100:00100000:2.0:1787853139.520103:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526169216 00000100:00100000:2.0:1787853139.520186:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 203 00000100:00100000:2.0:1787853139.520199:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4941742940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+50:11603:x1874699526169216:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:2.0:1787853139.520233:0:8462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853139.520267:0:8462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8000/0x710df789068e6f91 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c5079389967 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853139.520361:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8000/0x710df789068e6f91 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389967 expref: 51 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853139.520400:0:8462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8000/0x710df789068e6f91 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389967 expref: 51 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853139.520423:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8f4910aab000) 00010000:00010000:2.0:1787853139.520427:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787853139.520431:0:8462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49415b8000, rc 0) 00000100:00100000:2.0:1787853139.520503:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4941742940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+51:11603:x1874699526169216:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 308us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853139.520511:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 203 00000100:00100000:3.0:1787853139.523017:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853139.523199:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526169472 00000100:00100000:0.0:1787853139.523213:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526169472 00000100:00100000:0.0:1787853139.523288:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 57 00000100:00100000:0.0:1787853139.523300:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4908ca4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+51:11603:x1874699526169472:12345-192.168.204.1@tcp:35:lfs.0 00000100:00100000:0.0:1787853139.523679:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4908ca4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+52:11603:x1874699526169472:12345-192.168.204.1@tcp:35:lfs.0 Request processed in 381us (676us total) trans 4294967495 rc 0/0 00000100:00100000:0.0:1787853139.523688:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 57 00000100:00100000:1.0:1787853139.683718:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853139.683901:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526169600 00000100:00100000:0.0:1787853139.683917:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526169600 00000100:00100000:0.0:1787853139.684008:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 204 00000100:00100000:0.0:1787853139.684021:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4910d25a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+52:11613:x1874699526169600:12345-192.168.204.1@tcp:34:lfs.0 00010000:00010000:0.0:1787853139.684134:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6e00/0x710df789068e6f98 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.684158:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6e00/0x710df789068e6f98 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.684398:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6e00/0x710df789068e6f98 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.684421:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7e00/0x710df789068e6f9f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.684430:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7e00/0x710df789068e6f9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.684438:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7e00/0x710df789068e6f9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.684629:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6a00/0x710df789068e6fa6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.684657:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6a00/0x710df789068e6fa6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.684666:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6a00/0x710df789068e6fa6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787853139.684729:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6a00/0x710df789068e6fa6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.684745:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6e00/0x710df789068e6f98 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.684751:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6e00/0x710df789068e6f98 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.684758:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6e00/0x710df789068e6f98 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.684765:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b6e00 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:0.0:1787853139.684771:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6e00/0x710df789068e6f98 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.684779:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6e00/0x710df789068e6f98 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.684794:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8f4910f92100) 00010000:00010000:0.0:1787853139.684798:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787853139.684803:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6e00/0x710df789068e6f98 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.684810:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6e00/0x710df789068e6f98 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.684836:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7e00/0x710df789068e6f9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.684843:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7e00/0x710df789068e6f9f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.684849:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7e00/0x710df789068e6f9f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.684855:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b7e00 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:0.0:1787853139.684858:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7e00/0x710df789068e6f9f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.684864:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7e00/0x710df789068e6f9f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.684873:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8f491176bf00) 00010000:00010000:0.0:1787853139.684875:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787853139.684878:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7e00/0x710df789068e6f9f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.684885:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7e00/0x710df789068e6f9f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.684903:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6a00/0x710df789068e6fa6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.684910:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6a00/0x710df789068e6fa6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.684916:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6a00/0x710df789068e6fa6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.685061:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b6a00 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:0.0:1787853139.685065:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6a00/0x710df789068e6fa6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.685071:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6a00/0x710df789068e6fa6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.685082:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8f4910aab000) 00010000:00010000:0.0:1787853139.685084:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787853139.685088:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6a00/0x710df789068e6fa6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.685093:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6a00/0x710df789068e6fa6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853139.685212:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4910d25a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+52:11613:x1874699526169600:12345-192.168.204.1@tcp:34:lfs.0 Request processed in 1189us (1505us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853139.685222:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 204 00000100:00100000:3.0:1787853139.735512:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853139.735713:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526169856 00000100:00100000:0.0:1787853139.735726:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526169856 00000100:00100000:0.0:1787853139.735819:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 205 00000100:00100000:0.0:1787853139.735832:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4908ca5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+52:11616:x1874699526169856:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:0.0:1787853139.735862:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853139.735890:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6a00/0x710df789068e6fad lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c507938996e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.736000:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7e00/0x710df789068e6fb4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.736043:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7e00/0x710df789068e6fb4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.736060:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7e00/0x710df789068e6fb4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.736081:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6e00/0x710df789068e6fbb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.736089:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6e00/0x710df789068e6fbb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.736096:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6e00/0x710df789068e6fbb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.736290:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7400/0x710df789068e6fc2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.736300:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7400/0x710df789068e6fc2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.736308:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7400/0x710df789068e6fc2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787853139.736319:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1787853139.736453:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7e00/0x710df789068e6fb4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.736463:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7e00/0x710df789068e6fb4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.736470:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7e00/0x710df789068e6fb4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.736484:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b7e00 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:0.0:1787853139.736489:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7e00/0x710df789068e6fb4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.736498:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7e00/0x710df789068e6fb4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.736513:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8f4910f92100) 00010000:00010000:0.0:1787853139.736516:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787853139.736522:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7e00/0x710df789068e6fb4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.736529:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7e00/0x710df789068e6fb4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.736547:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6e00/0x710df789068e6fbb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.736554:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6e00/0x710df789068e6fbb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.736559:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6e00/0x710df789068e6fbb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.736564:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b6e00 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:0.0:1787853139.736651:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6e00/0x710df789068e6fbb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.736659:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6e00/0x710df789068e6fbb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.736679:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8f491176bf00) 00010000:00010000:0.0:1787853139.736682:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787853139.736685:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6e00/0x710df789068e6fbb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.736692:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6e00/0x710df789068e6fbb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.736748:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6a00/0x710df789068e6fad lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c507938996e expref: 55 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.736763:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7400/0x710df789068e6fc2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c507938996e expref: 54 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.736771:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8f4910aab000) 00010000:00010000:0.0:1787853139.736774:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787853139.736777:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49415b7400, rc 0) 00000100:00100000:0.0:1787853139.736873:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4908ca5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+54:11616:x1874699526169856:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 1044us (1379us total) trans 4294967496 rc 0/0 00000100:00100000:0.0:1787853139.736883:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 205 00000100:00100000:3.0:1787853139.752618:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853139.752724:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526169984 00000100:00100000:1.0:1787853139.752736:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526169984 00000100:00100000:1.0:1787853139.752806:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 206 00000100:00100000:1.0:1787853139.752817:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4908ca5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+54:11616:x1874699526169984:12345-192.168.204.1@tcp:54:lfs.0 00010000:00010000:1.0:1787853139.752888:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e6fd0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853139.752907:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e6fd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853139.752929:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e6fd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853139.752960:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e6fd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853139.752968:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e6fd0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853139.752998:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e6fd0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853139.753004:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f492a8ad200 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:1.0:1787853139.753009:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e6fd0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853139.753017:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e6fd0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853139.753031:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8f4910aab000) 00010000:00010000:1.0:1787853139.753034:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787853139.753038:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e6fd0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853139.753044:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e6fd0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853139.753124:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4908ca5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+54:11616:x1874699526169984:12345-192.168.204.1@tcp:54:lfs.0 Request processed in 308us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853139.753132:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 206 00010000:00010000:1.0:1787853139.753726:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787853139.761487:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853139.761733:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526170240 00000100:00100000:0.0:1787853139.761750:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526170240 00000100:00100000:0.0:1787853139.761822:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 58 00000100:00100000:0.0:1787853139.761832:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493bee9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+54:11616:x1874699526170240:12345-192.168.204.1@tcp:35:lfs.0 00000100:00100000:0.0:1787853139.762101:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493bee9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+55:11616:x1874699526170240:12345-192.168.204.1@tcp:35:lfs.0 Request processed in 270us (631us total) trans 4294967497 rc 0/0 00000100:00100000:0.0:1787853139.762110:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 58 00000100:00100000:3.0:1787853139.870029:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853139.870801:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526170496 00000100:00100000:0.0:1787853139.870812:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526170496 00000100:00100000:0.0:1787853139.870894:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 207 00000100:00100000:0.0:1787853139.870905:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493beeb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+55:11626:x1874699526170496:12345-192.168.204.1@tcp:101:bash.0 00010000:00010000:0.0:1787853139.870930:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853139.870933:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787853139.870960:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7800/0x710df789068e6f52 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389952 expref: 55 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.870982:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8f4910f92100) 00010000:00010000:0.0:1787853139.870987:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787853139.871001:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6a00/0x710df789068e6fd7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c5079389975 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.871097:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6e00/0x710df789068e6fde lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.871111:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6e00/0x710df789068e6fde lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.871120:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6e00/0x710df789068e6fde lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787853139.871130:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1787853139.871911:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6a00/0x710df789068e6fd7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389975 expref: 57 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.871930:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6e00/0x710df789068e6fde lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389975 expref: 56 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.871961:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8f4910aab000) 00010000:00010000:0.0:1787853139.871964:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787853139.871967:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49415b6e00, rc 0) 00000100:00100000:0.0:1787853139.872031:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493beeb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+56:11626:x1874699526170496:12345-192.168.204.1@tcp:101:bash.0 Request processed in 1128us (2013us total) trans 4294967498 rc 0/0 00000100:00100000:0.0:1787853139.872039:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 207 00000100:00100000:3.0:1787853139.876041:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853139.876621:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526170752 00000100:00100000:1.0:1787853139.876631:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526170752 00000100:00100000:1.0:1787853139.876953:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 208 00000100:00100000:1.0:1787853139.876964:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493bee83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+56:11626:x1874699526170752:12345-192.168.204.1@tcp:36:bash.0 00010000:00010000:1.0:1787853139.877020:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1787853139.877044:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6e00/0x710df789068e6fde lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389975 expref: 56 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853139.877087:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7400/0x710df789068e6fc2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c507938996e expref: 55 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853139.877097:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8f4910aab000) 00010000:00010000:1.0:1787853139.877102:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787853139.877553:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e6fec lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853139.877598:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e6fec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853139.877976:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e6fec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787853139.878041:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:1.0:1787853139.878068:0:5837:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007a72b8e7 reply state 00000000516e871c transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e6fec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853139.878078:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787853139.878403:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493bee83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+57:11626:x1874699526170752:12345-192.168.204.1@tcp:36:bash.0 Request processed in 1439us (2367us total) trans 4294967500 rc 0/0 00000100:00100000:1.0:1787853139.878411:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 208 00000020:00080000:1.0:1787853139.878417:0:5837:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787853139.885634:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853139.886177:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526170880 00000100:00100000:2.0:1787853139.886193:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526170880 00000100:00100000:2.0:1787853139.886272:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 209 00000100:00100000:2.0:1787853139.886285:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493bee9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+57:11626:x1874699526170880:12345-192.168.204.1@tcp:101:bash.0 00010000:00010000:2.0:1787853139.886330:0:8462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853139.886361:0:8462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e6ff3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c507938997c expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853139.886482:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8800/0x710df789068e6ffa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853139.886499:0:8462:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e6fec lrc: 2/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853139.886507:0:8462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8800/0x710df789068e6ffa lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853139.886529:0:8462:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e6fec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853139.886557:0:8462:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8800/0x710df789068e6ffa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.888673:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e6fec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.888695:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e6fec lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.888704:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e6fec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.888711:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f492a8ad200 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:0.0:1787853139.888715:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e6fec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.888724:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e6fec lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.888742:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8f4910aab000) 00010000:00010000:0.0:1787853139.888746:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787853139.888749:0:3293:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8800/0x710df789068e6ffa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.888759:0:3293:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8800/0x710df789068e6ffa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.888792:0:3293:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8800/0x710df789068e6ffa lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.888824:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e6fec lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.888832:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e6fec lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853139.889180:0:8462:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8800/0x710df789068e6ffa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853139.889189:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8800/0x710df789068e6ffa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787853139.889245:0:8462:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1787853139.889250:0:8462:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787853139.889276:0:8462:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8800/0x710df789068e6ffa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853139.889314:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e6ff3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c507938997c expref: 58 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853139.889331:0:8462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8800/0x710df789068e6ffa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c507938997c expref: 57 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853139.889339:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8f4910aab000) 00010000:00010000:2.0:1787853139.889342:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787853139.889345:0:8462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49415b8800, rc 0) 00000100:00100000:2.0:1787853139.889501:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493bee9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+57:11626:x1874699526170880:12345-192.168.204.1@tcp:101:bash.0 Request processed in 3217us (3936us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853139.889511:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 209 00000100:00100000:3.0:1787853139.892525:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853139.896640:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526171136 00000100:00100000:0.0:1787853139.896667:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526171136 00000100:00100000:0.0:1787853139.896743:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 59 00000100:00100000:0.0:1787853139.896754:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f48039f03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+57:11626:x1874699526171136:12345-192.168.204.1@tcp:35:bash.0 00000100:00100000:0.0:1787853139.897039:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f48039f03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+58:11626:x1874699526171136:12345-192.168.204.1@tcp:35:bash.0 Request processed in 285us (4529us total) trans 4294967501 rc 0/0 00000100:00100000:0.0:1787853139.897047:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 59 00000100:00100000:3.0:1787853139.966124:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853139.966260:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526171264 00000100:00100000:0.0:1787853139.966274:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526171264 00000100:00100000:0.0:1787853139.966374:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 210 00000100:00100000:0.0:1787853139.966386:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f48039f2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+58:11632:x1874699526171264:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:0.0:1787853139.966422:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853139.966452:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6a00/0x710df789068e7001 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c5079389983 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.966547:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7800/0x710df789068e7008 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.966618:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7800/0x710df789068e7008 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.966654:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7800/0x710df789068e7008 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787853139.966750:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:0.0:1787853139.966754:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787853139.966785:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7800/0x710df789068e7008 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.966820:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6a00/0x710df789068e7001 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389983 expref: 60 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.966948:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7800/0x710df789068e7008 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389983 expref: 59 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.966963:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8f4910f92100) 00010000:00010000:0.0:1787853139.966968:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787853139.966973:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49415b7800, rc 0) 00000100:00100000:0.0:1787853139.967079:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f48039f2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+59:11632:x1874699526171264:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 693us (969us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853139.967088:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 210 00000100:00100000:3.0:1787853139.970930:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853139.971025:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526171392 00000100:00100000:0.0:1787853139.971035:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526171392 00000100:00100000:0.0:1787853139.971100:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 211 00000100:00100000:0.0:1787853139.971113:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49031c2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+59:11632:x1874699526171392:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:0.0:1787853139.971139:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853139.971178:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7e00/0x710df789068e700f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c507938998a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.971286:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7400/0x710df789068e7016 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.971316:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7400/0x710df789068e7016 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.971332:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7400/0x710df789068e7016 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.971350:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6e00/0x710df789068e701d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.971367:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6e00/0x710df789068e701d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.971374:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6e00/0x710df789068e701d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.971496:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6400/0x710df789068e7024 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.971505:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6400/0x710df789068e7024 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.971513:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6400/0x710df789068e7024 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787853139.971554:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1787853139.971559:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787853139.971627:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6400/0x710df789068e7024 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.971653:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6400/0x710df789068e7024 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.971662:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7400/0x710df789068e7016 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.971669:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7400/0x710df789068e7016 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.971675:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7400/0x710df789068e7016 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.971687:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b7400 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:0.0:1787853139.971691:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7400/0x710df789068e7016 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.971701:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7400/0x710df789068e7016 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.971719:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8f4910f92100) 00010000:00010000:0.0:1787853139.971724:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787853139.971729:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7400/0x710df789068e7016 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.971737:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7400/0x710df789068e7016 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.971757:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6e00/0x710df789068e701d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.971764:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6e00/0x710df789068e701d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.971778:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6e00/0x710df789068e701d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.971783:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b6e00 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:0.0:1787853139.971786:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6e00/0x710df789068e701d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.971793:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6e00/0x710df789068e701d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.971802:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8f491176bf00) 00010000:00010000:0.0:1787853139.971804:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787853139.971807:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6e00/0x710df789068e701d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.971813:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6e00/0x710df789068e701d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.971852:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7e00/0x710df789068e700f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c507938998a expref: 61 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.971866:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6400/0x710df789068e7024 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c507938998a expref: 60 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.971874:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8f4910aab000) 00010000:00010000:0.0:1787853139.971891:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787853139.971895:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49415b6400, rc 0) 00000100:00100000:0.0:1787853139.971969:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49031c2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+60:11632:x1874699526171392:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 859us (1051us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853139.971987:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 211 00000100:00100000:3.0:1787853139.985927:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853139.985987:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853139.986152:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526171776 00000100:00100000:0.0:1787853139.986166:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526171776 00000100:00100000:1.0:1787853139.986261:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526171648 00000100:00100000:1.0:1787853139.986277:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526171648 00000100:00100000:0.0:1787853139.986282:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 15 00000100:00100000:0.0:1787853139.986300:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49341170c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+61:2362:x1874699526171776:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787853139.986322:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1787853139.986359:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 212 00010000:00010000:0.0:1787853139.986359:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6400/0x710df789068e7024 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c507938998a expref: 61 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853139.986377:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49031c2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+61:11632:x1874699526171648:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:0.0:1787853139.986394:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8f4910aab000) 00010000:00010000:1.0:1787853139.986398:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853139.986402:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787853139.986447:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ada00/0x710df789068e702b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c5079389991 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853139.986484:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49341170c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+61:2362:x1874699526171776:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 188us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853139.986494:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 15 00010000:00010000:1.0:1787853139.986559:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad600/0x710df789068e7032 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853139.986609:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8800/0x710df789068e6ffa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c507938997c expref: 60 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853139.986620:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad600/0x710df789068e7032 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853139.986655:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8800/0x710df789068e6ffa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.1@tcp remote: 0xd0a9c507938997c expref: 60 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853139.986670:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8800/0x710df789068e6ffa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c507938997c expref: 60 pid: 8462 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853139.986685:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4910d24f00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5837:1874699552377856:192.168.204.1@tcp:104: 00000100:00100000:1.0:1787853139.986787:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f490664ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1787853139.990936:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4910d24f00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5837:1874699552377856:192.168.204.1@tcp:104: 00010000:00010000:1.0:1787853139.990977:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad600/0x710df789068e7032 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853139.996418:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853139.996521:0:11175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526171904 00000100:00100000:0.0:1787853139.996535:0:11175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526171904 00010000:00010000:0.0:1787853139.996620:0:11175:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8800/0x710df789068e6ffa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c507938997c expref: 61 pid: 8462 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853139.996677:0:11175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 78 00000100:00100000:0.0:1787853139.996689:0:11175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4934117480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b1d98f5a-0be0-4f69-83a6-833c935c8205+61:2363:x1874699526171904:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787853139.996709:0:11175:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787853139.996717:0:11175:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8800/0x710df789068e6ffa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c507938997c expref: 61 pid: 8462 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.996735:0:11175:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8800/0x710df789068e6ffa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c507938997c expref: 61 pid: 8462 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.996788:0:11175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8800/0x710df789068e6ffa lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c507938997c expref: 61 pid: 8462 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.996810:0:11175:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8f4910aab000) 00010000:00010000:0.0:1787853139.996817:0:11175:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad600/0x710df789068e7032 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.996830:0:11175:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad600/0x710df789068e7032 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.996840:0:11175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad600/0x710df789068e7032 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853139.996869:0:11175:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787853139.996957:0:11175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4934117480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b1d98f5a-0be0-4f69-83a6-833c935c8205+60:2363:x1874699526171904:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 271us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853139.996966:0:11175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 78 00010000:00010000:1.0:1787853139.997933:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad600/0x710df789068e7032 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853139.997948:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad600/0x710df789068e7032 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787853139.998000:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1787853139.998223:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ada00/0x710df789068e702b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389991 expref: 61 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853139.998243:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad600/0x710df789068e7032 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389991 expref: 60 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853139.998252:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8f4910aab000) 00010000:00010000:1.0:1787853139.998254:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787853139.998258:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f492a8ad600, rc 0) 00000100:00100000:1.0:1787853139.998324:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49031c2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+60:11632:x1874699526171648:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 11952us (12416us total) trans 4294967502 rc 0/0 00000100:00100000:1.0:1787853139.998334:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 212 00000100:00100000:3.0:1787853140.008455:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853140.008631:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526172160 00000100:00100000:2.0:1787853140.008647:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526172160 00000100:00100000:2.0:1787853140.008749:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 16 00000100:00100000:2.0:1787853140.008780:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4934116580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+60:11632:x1874699526172160:12345-192.168.204.1@tcp:103:lfs.0 00010000:00010000:2.0:1787853140.008804:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787853140.008842:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8000/0x710df789068e6f91 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389967 expref: 60 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853140.008866:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8f4910aab000) 00010000:00010000:2.0:1787853140.008873:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787853140.008971:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4934116580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+59:11632:x1874699526172160:12345-192.168.204.1@tcp:103:lfs.0 Request processed in 193us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853140.008980:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 16 00000100:00080000:0.0:1787853140.009143:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787853140.012705:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853140.012883:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526172288 00000100:00100000:1.0:1787853140.012896:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526172288 00000100:00100000:1.0:1787853140.012971:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 213 00000100:00100000:1.0:1787853140.012982:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4912787840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+59:11632:x1874699526172288:12345-192.168.204.1@tcp:58:lfs.0 00010000:00010000:1.0:1787853140.013114:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ada00/0x710df789068e7040 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853140.013138:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ada00/0x710df789068e7040 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853140.013151:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ada00/0x710df789068e7040 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787853140.013420:0:8462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:1.0:1787853140.013558:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4912787840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+59:11632:x1874699526172288:12345-192.168.204.1@tcp:58:lfs.0 Request processed in 576us (866us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853140.013611:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 213 00000100:00100000:3.0:1787853140.016862:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853140.017214:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526172416 00000100:00100000:0.0:1787853140.017226:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526172416 00000100:00100000:0.0:1787853140.017313:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 214 00000100:00100000:0.0:1787853140.017324:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4912784f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+59:11632:x1874699526172416:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:0.0:1787853140.017352:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853140.017382:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6400/0x710df789068e7047 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c5079389998 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853140.017472:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ada00/0x710df789068e7040 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853140.017795:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6400/0x710df789068e7047 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389998 expref: 60 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853140.017825:0:5836:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ada00/0x710df789068e7040 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853140.017844:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6400/0x710df789068e7047 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389998 expref: 60 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853140.017867:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8f4910aab000) 00010000:00010000:0.0:1787853140.017872:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787853140.017876:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6400/0x710df789068e7047 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389998 expref: 60 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853140.017884:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49415b6400, rc 0) 00000100:00100000:2.0:1787853140.018045:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4912784f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+60:11632:x1874699526172416:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 721us (1198us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853140.018054:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 214 00000040:00080000:1.0:1787853140.458742:0:11690:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787853140.458759:0:11690:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787853140.458847:0:11690:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:1.0:1787853140.458856:0:11690:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787853140.459059:0:11690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4910d24f00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11690:1874699552377984:192.168.204.1@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787853140.459204:0:11690:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f4905074600 going to sleep for 11 seconds 00000100:00100000:3.0:1787853140.473722:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853140.474616:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526172544 00000100:00100000:2.0:1787853140.474635:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526172544 00000100:00100000:2.0:1787853140.474739:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 215 00000100:00100000:2.0:1787853140.474752:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4912785a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+61:11633:x1874699526172544:12345-192.168.204.1@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787853140.474798:0:8462:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787853140.474960:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4912785a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+61:11633:x1874699526172544:12345-192.168.204.1@tcp:53:lhsmtool_posix.0 Request processed in 212us (1249us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853140.474969:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 215 00000100:00100000:1.0:1787853140.477543:0:11690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4910d24f00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11690:1874699552377984:192.168.204.1@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787853140.480019:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853140.480492:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526172672 00000100:00100000:2.0:1787853140.480502:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526172672 00000100:00100000:2.0:1787853140.480601:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 216 00000100:00100000:2.0:1787853140.480611:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4912786d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+60:11633:x1874699526172672:12345-192.168.204.1@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787853140.480688:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8000/0x710df789068e704e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853140.480725:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8000/0x710df789068e704e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853140.480741:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8000/0x710df789068e704e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853140.480760:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e7055 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853140.480767:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e7055 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853140.480775:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e7055 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853140.480800:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9600/0x710df789068e705c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853140.480808:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9600/0x710df789068e705c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853140.480815:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9600/0x710df789068e705c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787853140.480860:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1787853140.480864:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787853140.480877:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9600/0x710df789068e705c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853140.480888:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8000/0x710df789068e704e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853140.480904:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8000/0x710df789068e704e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853140.480910:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8000/0x710df789068e704e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853140.480917:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b8000 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:2.0:1787853140.480921:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8000/0x710df789068e704e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853140.480929:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8000/0x710df789068e704e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853140.480941:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f4914d11600) 00010000:00010000:2.0:1787853140.480944:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787853140.480949:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8000/0x710df789068e704e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853140.480955:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8000/0x710df789068e704e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853140.480969:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e7055 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853140.480975:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e7055 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853140.480980:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e7055 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853140.480986:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b8c00 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:2.0:1787853140.480995:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e7055 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853140.481001:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e7055 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853140.481009:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff8f4910aab100) 00010000:00010000:2.0:1787853140.481023:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787853140.481026:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e7055 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853140.481032:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e7055 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853140.481046:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9600/0x710df789068e705c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853140.482309:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9600/0x710df789068e705c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853140.482316:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9600/0x710df789068e705c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853140.482321:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b9600 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:2.0:1787853140.482325:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9600/0x710df789068e705c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853140.482333:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9600/0x710df789068e705c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853140.482345:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8f4910aab000) 00010000:00010000:2.0:1787853140.482348:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787853140.482365:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9600/0x710df789068e705c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853140.482371:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9600/0x710df789068e705c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853140.482473:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4912786d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+60:11633:x1874699526172672:12345-192.168.204.1@tcp:34:lhsmtool_posix.0 Request processed in 1861us (2463us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853140.482483:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 216 00000100:00100000:0.0:1787853140.498147:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853140.502392:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526172928 00000100:00100000:2.0:1787853140.502409:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526172928 00000100:00100000:2.0:1787853140.502510:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 217 00000100:00100000:2.0:1787853140.502523:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4803aad2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+60:11633:x1874699526172928:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787853140.502547:0:8462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853140.502621:0:8462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9600/0x710df789068e7063 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c507938999f expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853140.502732:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e706a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853140.502749:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e706a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853140.502761:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e706a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787853140.502774:0:8462:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1787853140.502895:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e706a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853140.502904:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e706a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853140.502926:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e706a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853140.502934:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b8c00 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:2.0:1787853140.502938:0:8462:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e706a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853140.502946:0:8462:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e706a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853140.502960:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8f4910aab000) 00010000:00010000:2.0:1787853140.502963:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787853140.502968:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e706a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853140.502974:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e706a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853140.503024:0:8462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9600/0x710df789068e7063 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c507938999f expref: 62 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853140.503033:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f4914d11600) 00010000:00010000:2.0:1787853140.503036:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787853140.503039:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9600/0x710df789068e7063 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c507938999f expref: 62 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853140.503048:0:8462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49415b9600, rc 0) 00000100:00100000:2.0:1787853140.503127:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4803aad2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+61:11633:x1874699526172928:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 Request processed in 607us (5000us total) trans 4294967503 rc 301/301 00000100:00100000:2.0:1787853140.503145:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 217 00000100:00100000:0.0:1787853140.511748:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853140.511989:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526173056 00000100:00100000:2.0:1787853140.512004:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526173056 00000100:00100000:2.0:1787853140.512101:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 218 00000100:00100000:2.0:1787853140.512112:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4803aafc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+61:11633:x1874699526173056:12345-192.168.204.1@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787853140.512169:0:5836:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787853140.512302:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4803aafc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+61:11633:x1874699526173056:12345-192.168.204.1@tcp:53:lhsmtool_posix.0 Request processed in 191us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853140.512311:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 218 00000100:00100000:3.0:1787853140.539681:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853140.540053:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526173312 00000100:00100000:2.0:1787853140.540066:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526173312 00000100:00100000:2.0:1787853140.540128:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 219 00000100:00100000:2.0:1787853140.540139:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4912785680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+61:11633:x1874699526173312:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787853140.540177:0:8462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853140.540181:0:8462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787853140.540222:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7800/0x710df789068e7008 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389983 expref: 61 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853140.540247:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8f4910f92100) 00010000:00010000:2.0:1787853140.540254:0:8462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787853140.540280:0:8462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9600/0x710df789068e7078 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c50793899a6 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787853140.541134:0:8462:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:1.0:1787853140.541406:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad000/0x710df789068e707f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853140.541424:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad000/0x710df789068e707f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853140.541438:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad000/0x710df789068e707f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853140.541525:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9600/0x710df789068e7078 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793899a6 expref: 63 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853140.541546:0:8462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad000/0x710df789068e707f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793899a6 expref: 62 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853140.541598:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8f4914d11800) 00010000:00010000:1.0:1787853140.541602:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787853140.541621:0:8462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f492a8ad000, rc 0) 00000100:00100000:1.0:1787853140.541709:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4912785680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+62:11633:x1874699526173312:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 Request processed in 1571us (2043us total) trans 4294967504 rc 0/0 00000100:00100000:1.0:1787853140.541720:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 219 00000100:00100000:0.0:1787853140.547631:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853140.549132:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526173568 00000100:00100000:1.0:1787853140.549154:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526173568 00000100:00100000:1.0:1787853140.549244:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 220 00000100:00100000:1.0:1787853140.549258:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4803aaed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+62:11633:x1874699526173568:12345-192.168.204.1@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787853140.549340:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787853140.549378:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad000/0x710df789068e707f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793899a6 expref: 62 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853140.549402:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8f4914d11800) 00010000:00010000:1.0:1787853140.549416:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787853140.549447:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e708d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853140.549464:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e708d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853140.549476:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e708d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853140.549494:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ac000/0x710df789068e7094 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x7f44ea78 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853140.549501:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ac000/0x710df789068e7094 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x7f44ea78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853140.549508:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ac000/0x710df789068e7094 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x7f44ea78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853140.549690:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e708d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853140.549699:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e708d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853140.549706:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e708d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853140.549713:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f492a8ad200 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:1.0:1787853140.549718:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e708d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853140.549726:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e708d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853140.549736:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8f4910f92100) 00010000:00010000:1.0:1787853140.549740:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787853140.549745:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e708d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853140.549752:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e708d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853140.549761:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ac000/0x710df789068e7094 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x7f44ea78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853140.549768:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ac000/0x710df789068e7094 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x7f44ea78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853140.549775:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ac000/0x710df789068e7094 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x7f44ea78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853140.549788:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f492a8ac000 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:1.0:1787853140.549790:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ac000/0x710df789068e7094 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x7f44ea78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853140.549797:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ac000/0x710df789068e7094 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x7f44ea78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853140.549805:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x7f44ea78 (ffff8f4914d11c00) 00010000:00010000:1.0:1787853140.549808:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787853140.549810:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ac000/0x710df789068e7094 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x7f44ea78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853140.549817:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ac000/0x710df789068e7094 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x7f44ea78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853140.550066:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4803aaed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+61:11633:x1874699526173568:12345-192.168.204.1@tcp:36:lhsmtool_posix.0 Request processed in 809us (2449us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787853140.550075:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 220 00000100:00100000:0.0:1787853140.561149:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853140.564208:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526173696 00000100:00100000:3.0:1787853140.564230:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526173696 00000100:00100000:3.0:1787853140.564399:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 221 00000100:00100000:3.0:1787853140.564413:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4803aade00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+61:11633:x1874699526173696:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787853140.564452:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853140.564492:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21a00/0x710df789068e709b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c50793899ad expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853140.564564:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e70a2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853140.564634:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e70a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853140.564653:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e70a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853140.564823:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21a00/0x710df789068e709b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793899ad expref: 63 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853140.564851:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e70a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793899ad expref: 62 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853140.564863:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8f4910f92600) 00010000:00010000:3.0:1787853140.564866:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787853140.564871:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4921e20000, rc 0) 00000100:00100000:3.0:1787853140.564977:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4803aade00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+62:11633:x1874699526173696:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 Request processed in 567us (3843us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853140.564986:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 221 00000100:00100000:1.0:1787853140.577256:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853140.589588:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526173952 00000100:00100000:2.0:1787853140.589611:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526173952 00000100:00100000:2.0:1787853140.589719:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 222 00000100:00100000:2.0:1787853140.589751:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4910d24f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+62:11633:x1874699526173952:12345-192.168.204.1@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787853140.589887:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e70a9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853140.589914:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e70a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853140.589931:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e70a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787853140.590303:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:2.0:1787853140.590316:0:5836:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 460131745084ns, next at 461131741962ns, rc = 0 00000004:00010000:2.0:1787853140.590440:0:5836:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008fa6fbc3 reply state 00000000d5337341 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e70a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853140.590453:0:5836:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787853140.590654:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4910d24f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+64:11633:x1874699526173952:12345-192.168.204.1@tcp:36:lhsmtool_posix.0 Request processed in 903us (13412us total) trans 4294967505 rc 0/0 00000100:00100000:2.0:1787853140.590662:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 222 00010000:00010000:3.0:1787853140.595016:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e70a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853140.595040:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e70a9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853140.595049:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e70a9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853140.595057:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b8c00 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:3.0:1787853140.595063:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e70a9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853140.595071:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e70a9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853140.595106:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8f4910f92600) 00010000:00010000:3.0:1787853140.595110:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787853140.595117:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e70a9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853140.595124:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e70a9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853140.608779:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853140.611915:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526174080 00000100:00100000:2.0:1787853140.611941:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526174080 00000100:00100000:2.0:1787853140.612048:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 223 00000100:00100000:2.0:1787853140.612060:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4910d270c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+63:11633:x1874699526174080:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787853140.612098:0:8462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853140.612130:0:8462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8000/0x710df789068e70b0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c50793899b4 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853140.612222:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8000/0x710df789068e70b0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793899b4 expref: 64 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853140.612272:0:8462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8000/0x710df789068e70b0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793899b4 expref: 64 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853140.612297:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8f4910f92600) 00010000:00010000:2.0:1787853140.612301:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787853140.612305:0:8462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49415b8000, rc 0) 00000100:00100000:2.0:1787853140.612404:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4910d270c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+64:11633:x1874699526174080:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 Request processed in 345us (3642us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853140.612415:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 223 00000100:00100000:0.0:1787853140.622388:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853140.623270:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526174208 00000100:00100000:2.0:1787853140.623288:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526174208 00000100:00100000:2.0:1787853140.623402:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 65 00000100:00100000:2.0:1787853140.623416:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4803aaf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+9:2363:x1874699526174208:12345-192.168.204.1@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1787853140.623944:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4803aaf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+10:2363:x1874699526174208:12345-192.168.204.1@tcp:2:lhsmtool_posix.0 Request processed in 529us (1573us total) trans 4294967321 rc 0/0 00000100:00100000:2.0:1787853140.623956:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 65 00000100:00080000:0.0:1787853140.625230:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787853140.630268:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853140.631222:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526174464 00000100:00100000:1.0:1787853140.631240:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526174464 00000100:00100000:1.0:1787853140.631330:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 60 00000100:00100000:1.0:1787853140.631344:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4803aaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+64:11633:x1874699526174464:12345-192.168.204.1@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787853140.631739:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4803aaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+65:11633:x1874699526174464:12345-192.168.204.1@tcp:35:lhsmtool_posix.0 Request processed in 397us (1487us total) trans 4294967506 rc 0/0 00000100:00100000:1.0:1787853140.631749:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 60 00000100:00100000:3.0:1787853140.641088:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853140.643258:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526174720 00000100:00100000:2.0:1787853140.643281:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526174720 00000100:00100000:2.0:1787853140.643383:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 224 00000100:00100000:2.0:1787853140.643396:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493c5fed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+65:11633:x1874699526174720:12345-192.168.204.1@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787853140.643625:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493c5fed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+65:11633:x1874699526174720:12345-192.168.204.1@tcp:57:lhsmtool_posix.0 Request processed in 230us (2551us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853140.643634:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 224 00000100:00100000:0.0:1787853140.653197:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853140.659089:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526174848 00000100:00100000:3.0:1787853140.659117:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526174848 00000100:00100000:3.0:1787853140.659212:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 225 00000100:00100000:3.0:1787853140.660409:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4803aacb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+65:11633:x1874699526174848:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787853140.660444:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853140.660478:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21a00/0x710df789068e70b7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c50793899bb expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853140.661090:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21c00/0x710df789068e70be lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853140.661115:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21c00/0x710df789068e70be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853140.661132:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21c00/0x710df789068e70be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787853140.661189:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787853140.661214:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21c00/0x710df789068e70be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853140.661253:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21a00/0x710df789068e70b7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793899bb expref: 67 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853140.662763:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21c00/0x710df789068e70be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793899bb expref: 66 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853140.662786:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8f4910f92600) 00010000:00010000:3.0:1787853140.662789:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787853140.662794:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4921e21c00, rc 0) 00000100:00100000:3.0:1787853140.663185:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4803aacb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+66:11633:x1874699526174848:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 Request processed in 3956us (10008us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853140.669036:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 225 00000100:00100000:0.0:1787853140.672957:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853140.673649:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526174976 00000100:00100000:3.0:1787853140.673664:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526174976 00000100:00100000:3.0:1787853140.673733:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 66 00000100:00100000:3.0:1787853140.673761:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f492eb9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+10:2362:x1874699526174976:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787853140.673788:0:8463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853140.673818:0:8463:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d7ed99ec/0x710df789068e70c5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c50793899c2 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787853140.673856:0:8463:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a907955, blocks: 0x1 00010000:00010000:3.0:1787853140.673881:0:8463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=460s v=(0 0) 00010000:00010000:3.0:1787853140.673886:0:8463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787853140.673897:0:8463:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7ed99ec/0x710df789068e70c5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793899c2 expref: 11 pid: 8463 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853140.674370:0:8463:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d7ed99ec/0x710df789068e70c5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793899c2 expref: 11 pid: 8463 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853140.674390:0:8463:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4921e20400, rc 0) 00000100:00100000:0.0:1787853140.674609:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f492eb9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+11:2362:x1874699526174976:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 Request processed in 849us (1670us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853140.674620:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 66 00000100:00100000:1.0:1787853140.685653:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853140.686212:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526175232 00000100:00100000:2.0:1787853140.686250:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526175232 00000100:00100000:2.0:1787853140.686336:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 226 00000100:00100000:2.0:1787853140.686349:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4910d25e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+66:11633:x1874699526175232:12345-192.168.204.1@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787853140.686514:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4910d25e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+66:11633:x1874699526175232:12345-192.168.204.1@tcp:57:lhsmtool_posix.0 Request processed in 167us (876us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853140.686523:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 226 00000100:00100000:3.0:1787853140.711026:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853140.720800:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526175360 00000100:00100000:2.0:1787853140.720824:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526175360 00000100:00100000:2.0:1787853140.724251:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 67 00000100:00100000:2.0:1787853140.724301:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493c5fde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+11:11633:x1874699526175360:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787853140.724332:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853140.724360:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000881192f3/0x710df789068e70cc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c50793899c9 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853140.724408:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d7ed99ec/0x710df789068e70c5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793899c2 expref: 12 pid: 8463 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853140.724420:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787853140.724425:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787853140.724430:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000881192f3/0x710df789068e70cc lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793899c9 expref: 12 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853140.724479:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d7ed99ec/0x710df789068e70c5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793899c2 expref: 12 pid: 8463 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853140.724512:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d7ed99ec/0x710df789068e70c5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793899c2 expref: 12 pid: 8463 timeout: 560 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853140.724558:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f494159da40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6682:1874699552378112:192.168.204.1@tcp:104: 00000100:00100000:2.0:1787853140.724717:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f490573b900 going to sleep for 11 seconds 00000100:00100000:2.0:1787853140.729209:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f494159da40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6682:1874699552378112:192.168.204.1@tcp:104: 00010000:00010000:2.0:1787853140.729274:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000881192f3/0x710df789068e70cc lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793899c9 expref: 12 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853140.729305:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49415b8c00, rc 0) 00000100:00100000:2.0:1787853140.729394:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493c5fde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+12:11633:x1874699526175360:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 Request processed in 5115us (18385us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853140.729405:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 67 00000100:00100000:3.0:1787853140.741377:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853140.743356:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526175488 00000100:00100000:1.0:1787853140.743378:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526175488 00010000:00010000:1.0:1787853140.743446:0:8450:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d7ed99ec/0x710df789068e70c5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793899c2 expref: 12 pid: 8463 timeout: 560 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853140.743505:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 79 00000100:00100000:1.0:1787853140.743517:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4941af3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+12:2363:x1874699526175488:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787853140.743539:0:8450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787853140.744463:0:8450:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d7ed99ec/0x710df789068e70c5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793899c2 expref: 12 pid: 8463 timeout: 560 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853140.744486:0:8450:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d7ed99ec/0x710df789068e70c5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793899c2 expref: 12 pid: 8463 timeout: 560 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853140.744519:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7ed99ec/0x710df789068e70c5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793899c2 expref: 12 pid: 8463 timeout: 560 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853140.744539:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787853140.744544:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787853140.744564:0:8450:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000881192f3/0x710df789068e70cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793899c9 expref: 11 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853140.744613:0:8450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000881192f3/0x710df789068e70cc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793899c9 expref: 11 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853140.744673:0:8450:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000881192f3/0x710df789068e70cc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793899c9 expref: 11 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853140.744693:0:8450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f492eb9a580 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8450:1874699552378240:192.168.204.1@tcp:105: 00000100:00100000:0.0:1787853140.744836:0:8450:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f4904c00600 going to sleep for 11 seconds 00000100:00100000:3.0:1787853140.761557:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853140.761660:0:12023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526175616 00000100:00100000:2.0:1787853140.761674:0:12023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526175616 00002000:00100000:2.0:1787853140.761752:0:12023:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff8f4941af21c0 x1874699526175616/t0(0) o4->b1d98f5a-0be0-4f69-83a6-833c935c8205@192.168.204.1@tcp:316/0 lens 504/0 e 0 to 0 dl 1787853151 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787853140.761766:0:12023:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff8f4941af21c0 with x1874699526175616 ext(0->12) 00002000:00010000:2.0:1787853140.761773:0:12023:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8f4941af21c0 00000100:00100000:2.0:1787853140.761809:0:12023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 8 00000100:00100000:2.0:1787853140.761821:0:12023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4941af21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+12:2362:x1874699526175616:12345-192.168.204.1@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1787853140.762053:0:8450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f492eb9a580 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8450:1874699552378240:192.168.204.1@tcp:105: 00010000:00010000:1.0:1787853140.762104:0:8450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787853140.762190:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4941af3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+12:2363:x1874699526175488:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 18675us (20831us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853140.762202:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 79 00000100:00100000:2.0:1787853140.762415:0:12023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4941af21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+13:2362:x1874699526175616:12345-192.168.204.1@tcp:4:lhsmtool_posix.0 Request processed in 596us (886us total) trans 4294967322 rc 0/0 00000100:00100000:2.0:1787853140.762423:0:12023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 8 00002000:00100000:2.0:1787853140.762432:0:12023:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff8f4941af21c0 x1874699526175616/t4294967322(0) o4->b1d98f5a-0be0-4f69-83a6-833c935c8205@192.168.204.1@tcp:316/0 lens 504/448 e 0 to 0 dl 1787853151 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787853140.762448:0:12023:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff8f4941af21c0 with x1874699526175616 ext(0->12) 00002000:00010000:2.0:1787853140.762452:0:12023:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8f4941af21c0 00000100:00100000:0.0:1787853140.766437:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853140.770080:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526175744 00000100:00100000:2.0:1787853140.770104:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526175744 00000100:00100000:2.0:1787853140.770215:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 227 00000100:00100000:2.0:1787853140.770229:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f492eb9b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+66:11633:x1874699526175744:12345-192.168.204.1@tcp:44:lhsmtool_posix.0 00010000:00010000:0.0:1787853140.782815:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787853140.920922:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967501 is committed 00000004:00080000:2.0:1787853140.920957:0:5858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000001:00080000:2.0:1787853140.921279:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:2.0:1787853140.921297:0:5858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:2.0:1787853140.921320:0:5858:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8f4905074840 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:2.0:1787853140.921326:0:5858:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8f4910fbe400 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8f4905074e40 00000020:00080000:2.0:1787853140.921329:0:5858:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8f4910fbe600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8f494171e000 00000004:00080000:2.0:1787853140.921346:0:5858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000100:00100000:0.0:1787853140.921707:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f492eb9b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+44:11633:x1874699526175744:12345-192.168.204.1@tcp:44:lhsmtool_posix.0 Request processed in 151473us (155278us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853140.921739:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 227 00000100:00100000:3.0:1787853140.924795:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853140.925021:0:12025:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526175872 00000100:00100000:0.0:1787853140.925032:0:12025:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526175872 00000100:00100000:0.0:1787853140.925091:0:12025:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 68 00000100:00100000:0.0:1787853140.925101:0:12025:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4941af1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b1d98f5a-0be0-4f69-83a6-833c935c8205+13:2365:x1874699526175872:12345-192.168.204.1@tcp:16:lhsmtool_posix.0 00000020:00080000:2.0:1787853140.927530:0:5858:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8f493fd0a480 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:2.0:1787853140.927541:0:5858:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8f493fd35e00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8f493fd0a780 00000020:00080000:2.0:1787853140.927555:0:5858:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8f493fd35700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8f4904e9ac00 00000020:00080000:2.0:1787853140.927661:0:5870:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000100:00100000:0.0:1787853140.927781:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787853140.927814:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f492eb9a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874699552378496:0@lo:6:osp-syn-0-0.0 00000020:00080000:2.0:1787853140.927918:0:5870:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:2.0:1787853140.927945:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4941af1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874699552378368:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787853140.928104:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853140.928218:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552378496 00000100:00100000:0.0:1787853140.928228:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552378496 00000100:00100000:0.0:1787853140.928566:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787853140.928610:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493fe603c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1874699552378496:12345-0@lo:6:osp-syn-0-0.0 00000100:00080000:1.0:1787853140.929953:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:1.0:1787853140.929996:0:6681:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:1.0:1787853140.930028:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008dd73203/0x710df789068e70d3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853140.930052:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a8864ad2/0x710df789068e6e95 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389928 expref: 13 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853140.930061:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1787853140.930065:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787853140.930070:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008dd73203/0x710df789068e70d3 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853140.930413:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853140.930539:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787853140.930564:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f493ffa0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874699552378624:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1787853140.930633:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853140.930671:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552378368 00000100:00100000:3.0:1787853140.930679:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552378368 00000100:00100000:3.0:1787853140.930719:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552378624 00000100:00100000:3.0:1787853140.930722:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552378624 00000100:00100000:3.0:1787853140.930751:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787853140.930763:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493ffa1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3307:x1874699552378368:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1787853140.930790:0:8463:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00002000:00010000:3.0:1787853140.930820:0:8463:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a907953, atime: 0x6a907953, ctime: 0x6a907953, blocks: 0x1 00010000:00010000:3.0:1787853140.930827:0:8463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3a2c0b8/0x710df789068e70da lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853140.930837:0:8463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=460s v=(0 0) 00010000:00010000:3.0:1787853140.930841:0:8463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787853140.930847:0:8463:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d3a2c0b8/0x710df789068e70da lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853140.930864:0:8463:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d3a2c0b8/0x710df789068e70da lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853140.930875:0:8463:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3a2c0b8/0x710df789068e70da lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853140.930883:0:8463:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d3a2c0b8/0x710df789068e70da lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853140.930904:0:8463:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787853140.932089:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493ffa1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3307:x1874699552378368:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1326us (1673us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1787853140.932099:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00010000:00010000:1.0:1787853140.932373:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a8864ad2/0x710df789068e6e95 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389928 expref: 13 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853140.932393:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a8864ad2/0x710df789068e6e95 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389928 expref: 13 pid: 8463 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853140.932407:0:6681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4910d26580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6681:1874699552378752:192.168.204.1@tcp:104: 00000100:00100000:1.0:1787853140.932479:0:6681:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f490664af00 going to sleep for 11 seconds 00000100:00100000:2.0:1787853140.932640:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787853140.932651:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493ffa0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3308:x1874699552378624:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1787853140.932814:0:6682:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1787853140.932825:0:6682:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1787853141 00002000:00010000:2.0:1787853140.932827:0:6682:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787853140.932830:0:6682:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1787853141 -> 1787853141 00002000:00010000:2.0:1787853140.932832:0:6682:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1787853140.932874:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493ffa0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3308:x1874699552378624:12345-0@lo:2:osp-syn-0-0.0 Request processed in 225us (2240us total) trans 4294967323 rc 0/0 00000100:00100000:2.0:1787853140.932881:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787853140.932926:0:3308:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967318 gen 2 00000004:00080000:2.0:1787853140.932932:0:3308:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967318 00000100:00100000:2.0:1787853140.932953:0:3308:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8f493ffa0000 x1874699552378624/t4294967323(4294967323) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1787853156 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1787853140.932964:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8f493ffa0000/2, rc 0, transno 4294967323 00000100:00100000:2.0:1787853140.932970:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f493ffa0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874699552378624:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1787853140.934440:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8f4941af1e00/2, rc 0, transno 4294967310 00000100:00100000:3.0:1787853140.934451:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4941af1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874699552378368:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1787853140.934524:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787853140.934532:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d3a2c0b8/0x710df789068e70da lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853140.934553:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4921e21a00 already unused, calling callback (ffffffffc1528440) 00010000:00010000:2.0:1787853140.934558:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3a2c0b8/0x710df789068e70da lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853140.934586:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3a2c0b8/0x710df789068e70da lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853140.934607:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d3a2c0b8/0x710df789068e70da lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853140.934627:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d3a2c0b8/0x710df789068e70da lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853140.934650:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853140.934652:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853140.934654:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787853140.950087:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853140.950128:0:6681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4910d26580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6681:1874699552378752:192.168.204.1@tcp:104: 00010000:00010000:3.0:1787853140.950170:0:6681:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008dd73203/0x710df789068e70d3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853140.950835:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526176000 00000100:00100000:3.0:1787853140.950850:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526176000 00010000:00010000:3.0:1787853140.950906:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a8864ad2/0x710df789068e6e95 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389928 expref: 14 pid: 8463 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853140.950972:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 80 00000100:00100000:3.0:1787853140.950984:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4905687050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+14:2362:x1874699526176000:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787853140.951003:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787853140.951010:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a8864ad2/0x710df789068e6e95 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389928 expref: 14 pid: 8463 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853140.951025:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a8864ad2/0x710df789068e6e95 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389928 expref: 14 pid: 8463 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853140.951057:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a8864ad2/0x710df789068e6e95 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389928 expref: 14 pid: 8463 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853140.951079:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787853140.951084:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787853140.951091:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008dd73203/0x710df789068e70d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853140.951125:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008dd73203/0x710df789068e70d3 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853140.951166:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787853140.951245:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4905687050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+13:2362:x1874699526176000:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 262us (1172us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853140.951332:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 80 00010000:00010000:3.0:1787853140.951634:0:6681:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008dd73203/0x710df789068e70d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853140.951645:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008dd73203/0x710df789068e70d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853140.951658:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008dd73203/0x710df789068e70d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853140.951666:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008dd73203/0x710df789068e70d3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853140.951686:0:6681:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787853140.953239:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493fe603c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3309:x1874699552378496:12345-0@lo:6:osp-syn-0-0.0 Request processed in 24623us (25292us total) trans 4294967324 rc 0/0 00000100:00100000:3.0:1787853140.953324:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00010000:1.0:1787853140.955226:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787853140.955246:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008dd73203/0x710df789068e70d3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853140.955261:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f492a8ad000 already unused, calling callback (ffffffffc1528440) 00010000:00010000:1.0:1787853140.955266:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008dd73203/0x710df789068e70d3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853140.955287:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008dd73203/0x710df789068e70d3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853140.955311:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008dd73203/0x710df789068e70d3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853140.955320:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008dd73203/0x710df789068e70d3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853140.955373:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853140.955376:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853140.955383:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787853140.955698:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8f492eb9a580/2, rc 0, transno 4294967324 00000100:00100000:1.0:1787853140.955708:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f492eb9a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874699552378496:0@lo:6:osp-syn-0-0.0 00000001:00080000:2.0:1787853141.037692:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000100:00100000:1.0:1787853141.037938:0:12025:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4941af1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b1d98f5a-0be0-4f69-83a6-833c935c8205+7:2365:x1874699526175872:12345-192.168.204.1@tcp:16:lhsmtool_posix.0 Request processed in 112829us (113141us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853141.037954:0:12025:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 68 00000100:00100000:1.0:1787853141.042323:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853141.042503:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526176256 00000100:00100000:2.0:1787853141.042517:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526176256 00000100:00100000:2.0:1787853141.042756:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 228 00000100:00100000:2.0:1787853141.042771:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4910d26580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+20:11633:x1874699526176256:12345-192.168.204.1@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787853141.042863:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787853141.042917:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21c00/0x710df789068e70be lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793899bb expref: 20 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853141.042945:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8f4910f92600) 00010000:00010000:2.0:1787853141.042952:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787853141.042996:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8800/0x710df789068e70e1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853141.043015:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8800/0x710df789068e70e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853141.043028:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8800/0x710df789068e70e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787853141.044714:0:5837:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e4a38ec7 reply state 0000000063bcda2d transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8800/0x710df789068e70e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853141.044755:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787853141.046064:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4910d26580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+21:11633:x1874699526176256:12345-192.168.204.1@tcp:36:lhsmtool_posix.0 Request processed in 3284us (3745us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1787853141.046077:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 228 00010000:00010000:0.0:1787853141.050204:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8800/0x710df789068e70e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853141.050233:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8800/0x710df789068e70e1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853141.050242:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8800/0x710df789068e70e1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853141.050249:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b8800 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:0.0:1787853141.050256:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8800/0x710df789068e70e1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853141.050266:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8800/0x710df789068e70e1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853141.050289:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8f4910f92600) 00010000:00010000:0.0:1787853141.050309:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787853141.050316:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8800/0x710df789068e70e1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853141.050324:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8800/0x710df789068e70e1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853141.051070:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853141.051158:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526176384 00000100:00100000:0.0:1787853141.051172:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526176384 00000100:00100000:0.0:1787853141.051479:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 72 00000100:00100000:0.0:1787853141.051494:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493ffa4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+7:2362:x1874699526176384:12345-192.168.204.1@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1787853141.051823:0:6684:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1787853141.051828:0:6684:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1787853141 -> 1787853140 00002000:00010000:0.0:1787853141.051832:0:6684:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1787853139 00002000:00010000:0.0:1787853141.051835:0:6684:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1787853141 -> 1787853140 00002000:00010000:0.0:1787853141.051837:0:6684:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1787853141.051939:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493ffa4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+8:2362:x1874699526176384:12345-192.168.204.1@tcp:2:lhsmtool_posix.0 Request processed in 448us (876us total) trans 4294967325 rc 0/0 00000100:00100000:0.0:1787853141.051949:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 72 00000100:00100000:2.0:1787853141.057115:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853141.057211:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526176640 00000100:00100000:3.0:1787853141.057226:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526176640 00000100:00100000:3.0:1787853141.057319:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 229 00000100:00100000:3.0:1787853141.057330:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f494159da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+20:11633:x1874699526176640:12345-192.168.204.1@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787853141.057401:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e70e8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853141.057418:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e70a2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793899ad expref: 20 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853141.057549:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e70e8 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853141.057617:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e70a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793899ad expref: 20 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853141.057632:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e70a2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793899ad expref: 20 pid: 5838 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853141.057650:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f493ffa21c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5838:1874699552378880:192.168.204.1@tcp:104: 00000100:00100000:3.0:1787853141.057753:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f493480d9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787853141.062438:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f493ffa21c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5838:1874699552378880:192.168.204.1@tcp:104: 00010000:00010000:0.0:1787853141.062478:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e70e8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853141.064468:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853141.064626:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526176768 00000100:00100000:1.0:1787853141.064639:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526176768 00010000:00010000:1.0:1787853141.064692:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e70a2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793899ad expref: 21 pid: 5838 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853141.064730:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 81 00000100:00100000:1.0:1787853141.064742:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49056db0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+21:2362:x1874699526176768:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787853141.064760:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787853141.064768:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e70a2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793899ad expref: 21 pid: 5838 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853141.064783:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e70a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793899ad expref: 21 pid: 5838 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853141.064820:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e70a2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793899ad expref: 21 pid: 5838 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853141.064864:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8f4910f92600) 00010000:00010000:1.0:1787853141.064870:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e70e8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853141.064881:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e70e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853141.064890:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e70e8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853141.064937:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787853141.065013:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49056db0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+20:2362:x1874699526176768:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 272us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853141.065022:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 81 00010000:00010000:3.0:1787853141.066629:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e70e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853141.066649:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e70e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853141.066681:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e70e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853141.066689:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e70e8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853141.066717:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e70e8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853141.066723:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4921e20c00 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:3.0:1787853141.066727:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e70e8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853141.066735:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e70e8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853141.066753:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8f4910f92600) 00010000:00010000:3.0:1787853141.066757:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1787853141.066762:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e70e8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853141.066769:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e70e8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853141.066882:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f494159da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+19:11633:x1874699526176640:12345-192.168.204.1@tcp:55:lhsmtool_posix.0 Request processed in 9549us (9778us total) trans 0 rc -22/-22 00000100:00100000:3.0:1787853141.066893:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 229 00000100:00100000:2.0:1787853141.071284:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853141.071368:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526176896 00000100:00100000:3.0:1787853141.071383:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526176896 00000100:00100000:3.0:1787853141.071510:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 73 00000100:00100000:3.0:1787853141.071520:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493c58f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+8:2362:x1874699526176896:12345-192.168.204.1@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787853141.071613:0:8463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a8864ad2/0x710df789068e70ef lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853141.071633:0:8463:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000881192f3/0x710df789068e70cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793899c9 expref: 8 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853141.071654:0:8463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787853141.071658:0:8463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787853141.071663:0:8463:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a8864ad2/0x710df789068e70ef lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853141.071698:0:8463:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000881192f3/0x710df789068e70cc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793899c9 expref: 8 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853141.071711:0:8463:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000881192f3/0x710df789068e70cc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793899c9 expref: 8 pid: 6682 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853141.071726:0:8463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f493ffa3840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8463:1874699552379008:192.168.204.1@tcp:104: 00000100:00100000:3.0:1787853141.071806:0:8463:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f493480d480 going to sleep for 11 seconds 00000100:00100000:3.0:1787853141.079144:0:8463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f493ffa3840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8463:1874699552379008:192.168.204.1@tcp:104: 00010000:00010000:3.0:1787853141.079179:0:8463:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a8864ad2/0x710df789068e70ef lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853141.086281:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853141.086456:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526177024 00000100:00100000:1.0:1787853141.086469:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526177024 00010000:00010000:1.0:1787853141.086525:0:8450:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000881192f3/0x710df789068e70cc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793899c9 expref: 9 pid: 6682 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853141.086634:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 82 00000100:00100000:1.0:1787853141.086647:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493c58f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+9:2363:x1874699526177024:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787853141.086668:0:8450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787853141.086697:0:8450:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000881192f3/0x710df789068e70cc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793899c9 expref: 9 pid: 6682 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853141.086714:0:8450:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000881192f3/0x710df789068e70cc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793899c9 expref: 9 pid: 6682 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853141.086766:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000881192f3/0x710df789068e70cc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793899c9 expref: 9 pid: 6682 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853141.086787:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787853141.086792:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787853141.086800:0:8450:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a8864ad2/0x710df789068e70ef lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853141.086810:0:8450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a8864ad2/0x710df789068e70ef lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853141.086847:0:8450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787853141.086929:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493c58f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+8:2363:x1874699526177024:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 285us (673us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853141.086938:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 82 00010000:00010000:2.0:1787853141.088296:0:8463:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a8864ad2/0x710df789068e70ef lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853141.088319:0:8463:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a8864ad2/0x710df789068e70ef lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853141.088359:0:8463:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a8864ad2/0x710df789068e70ef lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853141.088368:0:8463:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a8864ad2/0x710df789068e70ef lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853141.088378:0:8463:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a8864ad2/0x710df789068e70ef lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853141.088386:0:8463:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4921e21800 already unused, calling callback (ffffffffc1528440) 00010000:00010000:2.0:1787853141.088390:0:8463:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8864ad2/0x710df789068e70ef lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853141.088420:0:8463:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8864ad2/0x710df789068e70ef lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853141.088441:0:8463:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a8864ad2/0x710df789068e70ef lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853141.088448:0:8463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a8864ad2/0x710df789068e70ef lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853141.088880:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493c58f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+7:2362:x1874699526176896:12345-192.168.204.1@tcp:1:lhsmtool_posix.0 Request processed in 17045us (17305us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853141.089046:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 73 00000100:00100000:2.0:1787853141.102438:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853141.102613:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526177280 00000100:00100000:0.0:1787853141.102628:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526177280 00000100:00100000:0.0:1787853141.102711:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 230 00000100:00100000:0.0:1787853141.102724:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493c58e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+19:11633:x1874699526177280:12345-192.168.204.1@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787853141.102836:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6800/0x710df789068e70f6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853141.102884:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6800/0x710df789068e70f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853141.102912:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6800/0x710df789068e70f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853141.103353:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7600/0x710df789068e70fd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853141.103371:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8000/0x710df789068e70b0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793899b4 expref: 20 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853141.103382:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7600/0x710df789068e70fd lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853141.103425:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8000/0x710df789068e70b0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793899b4 expref: 20 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853141.103442:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8000/0x710df789068e70b0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793899b4 expref: 20 pid: 8462 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853141.103458:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f493fe630c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5836:1874699552379136:192.168.204.1@tcp:104: 00000100:00100000:1.0:1787853141.108029:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f4904c009c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787853141.115332:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853141.115694:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526177408 00000100:00100000:2.0:1787853141.115708:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526177408 00010000:00010000:2.0:1787853141.115770:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8000/0x710df789068e70b0 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793899b4 expref: 21 pid: 8462 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853141.115829:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 83 00000100:00100000:2.0:1787853141.115841:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493fe61680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+21:2362:x1874699526177408:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787853141.115863:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787853141.115872:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8000/0x710df789068e70b0 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793899b4 expref: 21 pid: 8462 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853141.115888:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8000/0x710df789068e70b0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793899b4 expref: 21 pid: 8462 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853141.115954:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8f4910f92600) 00010000:00010000:2.0:1787853141.115961:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7600/0x710df789068e70fd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853141.115972:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7600/0x710df789068e70fd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853141.115980:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7600/0x710df789068e70fd lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853141.116003:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787853141.116082:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493fe61680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+21:2362:x1874699526177408:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 242us (766us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853141.116091:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 83 00010000:00010000:1.0:1787853141.116980:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8000/0x710df789068e70b0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c50793899b4 expref: 20 pid: 8462 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853141.117006:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f493fe630c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5836:1874699552379136:192.168.204.1@tcp:104: 00010000:00010000:1.0:1787853141.117034:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7600/0x710df789068e70fd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853141.117047:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7600/0x710df789068e70fd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853141.117069:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7600/0x710df789068e70fd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787853141.117670:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:1.0:1787853141.118636:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:1.0:1787853141.118708:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:1.0:1787853141.118826:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f493ffa5a40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5836:1874699552379264:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787853141.120702:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853141.120860:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f4906401780 going to sleep for 11 seconds 00000100:00100000:3.0:1787853141.125109:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552379264 00000100:00100000:3.0:1787853141.125132:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552379264 00000100:00100000:3.0:1787853141.125744:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787853141.125759:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493ffa4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5836:x1874699552379264:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1787853141.125967:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493ffa4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5836:x1874699552379264:12345-0@lo:1000:mdt00_000.0 Request processed in 211us (5276us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853141.125976:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787853141.126098:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f493ffa5a40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5836:1874699552379264:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1787853141.128086:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:1.0:1787853141.128862:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f493ffa5a40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5836:1874699552379392:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787853141.128985:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853141.135786:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f4906401c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787853141.137687:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552379392 00000100:00100000:0.0:1787853141.137710:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552379392 00000100:00100000:0.0:1787853141.137804:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787853141.137817:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493ffa4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5836:x1874699552379392:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787853141.139196:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493ffa4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:5836:x1874699552379392:12345-0@lo:1000:mdt00_000.0 Request processed in 1372us (10203us total) trans 4294967326 rc 0/0 00000100:00100000:0.0:1787853141.139229:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787853141.143535:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f493ffa5a40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5836:1874699552379392:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1787853141.143837:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7600/0x710df789068e70fd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853141.143855:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7600/0x710df789068e70fd lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853141.143865:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7600/0x710df789068e70fd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853141.143873:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b7600 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:2.0:1787853141.143878:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7600/0x710df789068e70fd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853141.143916:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7600/0x710df789068e70fd lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853141.143943:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8f4910f92600) 00010000:00010000:2.0:1787853141.143946:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787853141.143953:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7600/0x710df789068e70fd lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853141.143960:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7600/0x710df789068e70fd lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853141.144010:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ada00/0x710df789068e7040 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853141.144018:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ada00/0x710df789068e7040 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853141.144025:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ada00/0x710df789068e7040 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853141.144030:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f492a8ada00 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:2.0:1787853141.144032:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ada00/0x710df789068e7040 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853141.144037:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ada00/0x710df789068e7040 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853141.144045:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8f4910aab000) 00010000:00010000:2.0:1787853141.144047:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787853141.144057:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6400/0x710df789068e7047 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389998 expref: 23 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853141.144084:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6400/0x710df789068e7047 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389998 expref: 23 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853141.144095:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6400/0x710df789068e7047 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389998 expref: 23 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853141.144722:0:5836:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6400/0x710df789068e7047 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389998 expref: 23 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853141.144746:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f493c58c780 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5836:1874699552379520:192.168.204.1@tcp:105: 00000100:00100000:2.0:1787853141.144951:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f490573bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787853141.159507:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f493c58c780 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5836:1874699552379520:192.168.204.1@tcp:105: 00010000:00010000:2.0:1787853141.159564:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ada00/0x710df789068e7040 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853141.159621:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ada00/0x710df789068e7040 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853141.159672:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8600/0x710df789068e7104 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853141.159692:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8600/0x710df789068e7104 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853141.159708:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8600/0x710df789068e7104 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853141.159720:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8600/0x710df789068e7104 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853141.159742:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8600/0x710df789068e7104 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853141.159750:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8600/0x710df789068e7104 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853141.159757:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b8600 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:2.0:1787853141.159763:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8600/0x710df789068e7104 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853141.159772:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8600/0x710df789068e7104 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853141.159789:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8f4910aab000) 00010000:00010000:2.0:1787853141.159792:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787853141.159797:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8600/0x710df789068e7104 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853141.159803:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8600/0x710df789068e7104 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853141.159816:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6800/0x710df789068e70f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853141.159823:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6800/0x710df789068e70f6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853141.159830:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6800/0x710df789068e70f6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853141.159835:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b6800 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:2.0:1787853141.159845:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6800/0x710df789068e70f6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853141.159853:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6800/0x710df789068e70f6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853141.159862:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8f4910aab000) 00010000:00010000:2.0:1787853141.159865:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787853141.159868:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6800/0x710df789068e70f6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853141.159875:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6800/0x710df789068e70f6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853141.160455:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493c58e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+23:11633:x1874699526177280:12345-192.168.204.1@tcp:57:lhsmtool_posix.0 Request processed in 57728us (58029us total) trans 4294967512 rc 0/0 00000100:00100000:2.0:1787853141.160470:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 230 00000020:00080000:2.0:1787853141.160479:0:5836:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1787853141.160758:0:11690:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787853141.160765:0:11690:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787853141.160799:0:11690:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:1.0:1787853141.160807:0:11690:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787853141.161120:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853141.161951:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526177536 00000100:00100000:1.0:1787853141.161966:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526177536 00000100:00100000:1.0:1787853141.162027:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 61 00000100:00100000:1.0:1787853141.162040:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493fe62940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+23:11632:x1874699526177536:12345-192.168.204.1@tcp:49:lfs.0 00000100:00100000:1.0:1787853141.162218:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493fe62940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+23:11632:x1874699526177536:12345-192.168.204.1@tcp:49:lfs.0 Request processed in 180us (1098us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853141.162226:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 61 00000100:00100000:0.0:1787853141.174267:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853141.178032:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853141.181106:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526177792 00000100:00100000:2.0:1787853141.181124:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526177792 00000100:00100000:2.0:1787853141.181231:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 231 00000100:00100000:2.0:1787853141.181242:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493fe61e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+23:11632:x1874699526177792:12345-192.168.204.1@tcp:58:lfs.0 00000040:00080000:2.0:1787853141.182119:0:8462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:0.0:1787853141.183519:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493fe61e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+23:11632:x1874699526177792:12345-192.168.204.1@tcp:58:lfs.0 Request processed in 2263us (9266us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853141.183548:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 231 00000100:00100000:1.0:1787853141.189651:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526178048 00000100:00100000:1.0:1787853141.189679:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526178048 00000100:00100000:0.0:1787853141.193150:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 62 00000100:00100000:0.0:1787853141.193170:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4910408850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+23:11633:x1874699526178048:12345-192.168.204.1@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1787853141.197150:0:5840:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1787853141.202455:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:0.0:1787853141.202832:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6600/0x710df789068e710b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853141.202859:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6600/0x710df789068e710b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853141.202875:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6600/0x710df789068e710b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853141.202886:0:5840:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6600/0x710df789068e710b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853141.204263:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6600/0x710df789068e710b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853141.204283:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6600/0x710df789068e710b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853141.204323:0:5840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787853141.204513:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4910408850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+25:11633:x1874699526178048:12345-192.168.204.1@tcp:35:lhsmtool_posix.0 Request processed in 11340us (26489us total) trans 4294967514 rc 0/0 00000100:00100000:0.0:1787853141.204526:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 62 00000020:00080000:0.0:1787853141.204535:0:5840:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787853141.207109:0:8449:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787853141.207129:0:8449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6600/0x710df789068e710b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853141.207153:0:8449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b6600 already unused, calling callback (ffffffffc1528440) 00010000:00010000:2.0:1787853141.207159:0:8449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6600/0x710df789068e710b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853141.207195:0:8449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6600/0x710df789068e710b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853141.207223:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8f491176bf00) 00010000:00010000:2.0:1787853141.207227:0:8449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787853141.207235:0:8449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6600/0x710df789068e710b lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853141.207243:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6600/0x710df789068e710b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853141.207275:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853141.207277:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853141.207279:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787853141.253753:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853141.253978:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526178176 00000100:00100000:2.0:1787853141.253993:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526178176 00000100:00100000:2.0:1787853141.254082:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 232 00000100:00100000:2.0:1787853141.254096:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493ffa3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+25:11635:x1874699526178176:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:2.0:1787853141.254132:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853141.254171:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8600/0x710df789068e7112 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c50793899d0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853141.254261:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8a00/0x710df789068e7119 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853141.254278:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8a00/0x710df789068e7119 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853141.254292:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8a00/0x710df789068e7119 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853141.254330:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8000/0x710df789068e7120 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853141.254338:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8000/0x710df789068e7120 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853141.254344:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8000/0x710df789068e7120 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853141.254775:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e7127 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853141.254790:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad600/0x710df789068e7032 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389991 expref: 26 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853141.254801:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e7127 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853141.254851:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad600/0x710df789068e7032 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389991 expref: 26 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853141.254871:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad600/0x710df789068e7032 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389991 expref: 26 pid: 5837 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853141.254889:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f493c58c780 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5837:1874699552379648:192.168.204.1@tcp:104: 00000100:00100000:2.0:1787853141.255027:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f490573b180 going to sleep for 11 seconds 00000100:00100000:3.0:1787853141.278320:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853141.278440:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526178432 00000100:00100000:1.0:1787853141.278452:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526178432 00000100:00100000:1.0:1787853141.278534:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 63 00000100:00100000:1.0:1787853141.278555:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493ffa03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+27:5607:x1874699526178432:12345-192.168.204.1@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787853141.278884:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493ffa03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+28:5607:x1874699526178432:12345-192.168.204.1@tcp:35:ldlm_bl.0 Request processed in 331us (581us total) trans 4294967515 rc 0/0 00000100:00100000:1.0:1787853141.278892:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 63 00000100:00100000:2.0:1787853141.280696:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f493c58c780 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5837:1874699552379648:192.168.204.1@tcp:104: 00010000:00010000:2.0:1787853141.280740:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e7127 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853141.290471:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853141.290843:0:11175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526178560 00000100:00100000:0.0:1787853141.290857:0:11175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526178560 00010000:00010000:0.0:1787853141.290930:0:11175:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad600/0x710df789068e7032 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389991 expref: 28 pid: 5837 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853141.290989:0:11175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 84 00000100:00100000:0.0:1787853141.291003:0:11175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493ffa30c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b1d98f5a-0be0-4f69-83a6-833c935c8205+28:2362:x1874699526178560:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787853141.291024:0:11175:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787853141.291033:0:11175:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad600/0x710df789068e7032 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389991 expref: 28 pid: 5837 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853141.291050:0:11175:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad600/0x710df789068e7032 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389991 expref: 28 pid: 5837 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853141.291082:0:11175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad600/0x710df789068e7032 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389991 expref: 28 pid: 5837 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853141.291103:0:11175:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8f4910aab000) 00010000:00010000:0.0:1787853141.291109:0:11175:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e7127 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853141.291120:0:11175:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e7127 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853141.291129:0:11175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e7127 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853141.291192:0:11175:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787853141.291264:0:11175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493ffa30c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b1d98f5a-0be0-4f69-83a6-833c935c8205+27:2362:x1874699526178560:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 264us (811us total) trans 0 rc 0/0 00010000:00010000:2.0:1787853141.291411:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e7127 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853141.291422:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e7127 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787853141.291479:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1787853141.291495:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787853141.291521:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e7127 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853141.291548:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e7127 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853141.291560:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8a00/0x710df789068e7119 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853141.291568:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8a00/0x710df789068e7119 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853141.291602:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8a00/0x710df789068e7119 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853141.291610:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b8a00 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:2.0:1787853141.291616:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8a00/0x710df789068e7119 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853141.291625:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8a00/0x710df789068e7119 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853141.291636:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8f4910f92100) 00010000:00010000:2.0:1787853141.291647:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787853141.291653:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8a00/0x710df789068e7119 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853141.291660:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8a00/0x710df789068e7119 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853141.291675:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8000/0x710df789068e7120 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853141.291682:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8000/0x710df789068e7120 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853141.291688:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8000/0x710df789068e7120 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853141.291694:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b8000 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:2.0:1787853141.291697:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8000/0x710df789068e7120 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853141.291704:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8000/0x710df789068e7120 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853141.291712:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8f4910aabc00) 00010000:00010000:2.0:1787853141.291715:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787853141.291718:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8000/0x710df789068e7120 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853141.291724:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8000/0x710df789068e7120 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853141.291767:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8600/0x710df789068e7112 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793899d0 expref: 28 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853141.291798:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e7127 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793899d0 expref: 27 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853141.291808:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8f4910aab000) 00010000:00010000:2.0:1787853141.291811:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787853141.291814:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49415b8c00, rc 0) 00000100:00100000:2.0:1787853141.291850:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493ffa3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+27:11635:x1874699526178176:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 37758us (38118us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853141.291859:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 232 00000100:00100000:0.0:1787853141.292026:0:11175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 84 00000100:00100000:0.0:1787853141.742544:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f493c58c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5d48a955-7010-4118-9c7d-f396984ae1ff:3306:1874699552379776:0@lo:400:kworker.0 00000100:00100000:0.0:1787853141.742672:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853141.742740:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f493c5a6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1874699552380288:0@lo:400:kworker.0 00000100:00100000:0.0:1787853141.742775:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853141.742812:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787853141.742818:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4934234b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874699552379904:0@lo:400:kworker.0 00000100:00100000:0.0:1787853141.742845:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853141.742863:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f493c5a4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552380416:0@lo:400:kworker.0 00000100:00100000:0.0:1787853141.742891:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853141.742929:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552379776 00000100:00100000:0.0:1787853141.742938:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552379776 00000100:00100000:0.0:1787853141.742994:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1787853141.743002:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4906231850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+19:3306:x1874699552379776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853141.743068:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4906231850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+19:3306:x1874699552379776:12345-0@lo:400:kworker.0 Request processed in 65us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853141.743075:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1787853141.743113:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552380288 00000100:00100000:0.0:1787853141.743116:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552380288 00000100:00100000:0.0:1787853141.743162:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552379904 00000100:00100000:0.0:1787853141.743166:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552379904 00000100:00100000:0.0:1787853141.743185:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1787853141.743191:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493fe62940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874699552380288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853141.743245:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493fe62940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874699552380288:12345-0@lo:400:kworker.0 Request processed in 54us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853141.743252:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1787853141.743276:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1787853141.743283:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493fe62580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874699552379904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853141.743312:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493fe62580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874699552379904:12345-0@lo:400:kworker.0 Request processed in 30us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853141.743318:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1787853141.743344:0:12025:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552380416 00000100:00100000:0.0:1787853141.743348:0:12025:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552380416 00000100:00100000:0.0:1787853141.743379:0:12025:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787853141.743386:0:12025:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493fe62d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3306:x1874699552380416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853141.743427:0:12025:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493fe62d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3306:x1874699552380416:12345-0@lo:400:kworker.0 Request processed in 42us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853141.743434:0:12025:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00080000:0.0:1787853141.743456:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787853141.743462:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787853141.743499:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4934234b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874699552379904:0@lo:400:kworker.0 00000100:00100000:0.0:1787853141.743511:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f493c5a4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552380416:0@lo:400:kworker.0 00000100:00100000:0.0:1787853141.743519:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f493c58c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5d48a955-7010-4118-9c7d-f396984ae1ff:3306:1874699552379776:0@lo:400:kworker.0 00000100:00100000:0.0:1787853141.743540:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f493c5a6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1874699552380288:0@lo:400:kworker.0 00000100:00100000:3.0:1787853141.748774:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49342370c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1874699552380160:0@lo:400:kworker.0 00000100:00100000:3.0:1787853141.748890:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853141.748996:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787853141.749005:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4934234000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874699552380032:0@lo:400:kworker.0 00000100:00100000:3.0:1787853141.749036:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853141.752897:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552380032 00000100:00100000:2.0:1787853141.752921:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552380032 00000100:00100000:2.0:1787853141.753006:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787853141.753018:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493ffa2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3309:x1874699552380032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853141.753165:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493ffa2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3309:x1874699552380032:12345-0@lo:400:kworker.0 Request processed in 149us (4127us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853141.753175:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787853141.753420:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4934234000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874699552380032:0@lo:400:kworker.0 00000100:00100000:0.0:1787853141.754328:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552380160 00000100:00100000:0.0:1787853141.754341:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552380160 00000100:00100000:0.0:1787853141.754412:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1787853141.754421:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493ffa1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874699552380160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853141.754539:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493ffa1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874699552380160:12345-0@lo:400:kworker.0 Request processed in 108us (5638us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853141.754547:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1787853141.754640:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49342370c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1874699552380160:0@lo:400:kworker.0 00000100:00080000:2.0:1787853141.754875:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787853141.810751:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787853142.194927:0:11690:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787853142.194941:0:11690:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787853142.194986:0:11690:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1787853142.194994:0:11690:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787853142.195167:0:11690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f493c5a6940 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11690:1874699552380544:192.168.204.1@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787853142.195846:0:11690:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f493c04eb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787853142.204825:0:11690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f493c5a6940 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11690:1874699552380544:192.168.204.1@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787853142.205267:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853142.205460:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526178688 00000100:00100000:2.0:1787853142.205469:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526178688 00000100:00100000:2.0:1787853142.205560:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 233 00000100:00100000:2.0:1787853142.205595:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493ffa7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+26:11646:x1874699526178688:12345-192.168.204.1@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787853142.205639:0:5836:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787853142.205764:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493ffa7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+26:11646:x1874699526178688:12345-192.168.204.1@tcp:53:lhsmtool_posix.0 Request processed in 194us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853142.205772:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 233 00000100:00080000:3.0:1787853142.212856:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787853142.213141:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853142.213239:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526178944 00000100:00100000:3.0:1787853142.213259:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526178944 00000100:00100000:3.0:1787853142.213330:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 234 00000100:00100000:3.0:1787853142.213343:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493ffa43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+26:11646:x1874699526178944:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787853142.213373:0:8462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853142.213405:0:8462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21800/0x710df789068e712e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c50793899d7 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853142.213559:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e7135 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853142.213856:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e7135 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853142.213871:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e7135 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787853142.213889:0:8462:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1787853142.214066:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21800/0x710df789068e712e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793899d7 expref: 29 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853142.214089:0:8462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e7135 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793899d7 expref: 28 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853142.214099:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8f4910aab000) 00010000:00010000:3.0:1787853142.214103:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787853142.214107:0:8462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4921e20c00, rc 0) 00000100:00100000:3.0:1787853142.214178:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493ffa43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+28:11646:x1874699526178944:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 Request processed in 837us (1046us total) trans 4294967516 rc 0/0 00000100:00100000:3.0:1787853142.214187:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 234 00000100:00100000:3.0:1787853142.220490:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853142.222067:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526179072 00000100:00100000:1.0:1787853142.222085:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526179072 00000100:00100000:1.0:1787853142.222193:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 17 00000100:00100000:1.0:1787853142.222206:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493ffa1e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+28:2365:x1874699526179072:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787853142.222228:0:8450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787853142.222282:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e7135 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793899d7 expref: 28 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853142.222309:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8f4910aab000) 00010000:00010000:1.0:1787853142.222315:0:8450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787853142.222401:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493ffa1e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+27:2365:x1874699526179072:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 198us (1927us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853142.222409:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 17 00000100:00100000:0.0:1787853142.223133:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853142.223643:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526179328 00000100:00100000:3.0:1787853142.223655:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526179328 00000100:00100000:3.0:1787853142.223708:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 235 00000100:00100000:3.0:1787853142.223717:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493fe63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+27:11646:x1874699526179328:12345-192.168.204.1@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787853142.223822:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e7143 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853142.223843:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e7143 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853142.223858:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e7143 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853142.224112:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e7143 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853142.224121:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e7143 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853142.224145:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e7143 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853142.224152:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4921e20000 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:3.0:1787853142.224157:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e7143 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853142.224166:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e7143 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853142.224179:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8f4910aab000) 00010000:00010000:3.0:1787853142.224183:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787853142.224188:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e7143 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853142.224195:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e7143 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853142.224387:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493fe63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+28:11646:x1874699526179328:12345-192.168.204.1@tcp:57:lhsmtool_posix.0 Request processed in 670us (1258us total) trans 4294967517 rc 0/0 00000100:00100000:3.0:1787853142.224398:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 235 00000040:00080000:0.0:1787853142.228829:0:11690:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787853142.228843:0:11690:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787853142.229345:0:11690:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1787853142.229356:0:11690:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787853142.239717:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853142.239805:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526179584 00000100:00100000:1.0:1787853142.239820:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526179584 00000100:00100000:1.0:1787853142.239898:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 64 00000100:00100000:1.0:1787853142.239924:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493fe63c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+28:11646:x1874699526179584:12345-192.168.204.1@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787853142.240326:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493fe63c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+29:11646:x1874699526179584:12345-192.168.204.1@tcp:35:lhsmtool_posix.0 Request processed in 415us (624us total) trans 4294967518 rc 0/0 00000100:00100000:1.0:1787853142.240335:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 64 00000100:00100000:3.0:1787853142.252932:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f493fe60780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874699552380672:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787853142.253034:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853142.254339:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f493ffa70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874699552380800:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787853142.254407:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853142.264610:0:10348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552380672 00000100:00100000:0.0:1787853142.264638:0:10348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552380672 00000100:00100000:3.0:1787853142.279389:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552380800 00000100:00100000:3.0:1787853142.279410:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552380800 00000100:00100000:3.0:1787853142.281631:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787853142.281657:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493ffa5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1874699552380800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787853142.281716:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787853142.281837:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493ffa5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1874699552380800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 194us (27431us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853142.281845:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787853142.284552:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f493ffa70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874699552380800:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787853142.290539:0:10348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787853142.290558:0:10348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493ffa2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3308:x1874699552380672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787853142.290657:0:10348:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 54460416 pending 0 free 3859808256 avail 3855613952 00000100:00100000:0.0:1787853142.290777:0:10348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493ffa2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3308:x1874699552380672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 226us (37743us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853142.290786:0:10348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:3.0:1787853142.291030:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787853142.293331:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f493fe60780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874699552380672:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787853142.825753:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787853142.918478:0:12524:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787853142.918492:0:12524:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787853142.918561:0:12524:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1787853142.918599:0:12524:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787853143.210111:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853143.210274:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526179840 00000100:00100000:1.0:1787853143.210289:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526179840 00000100:00100000:1.0:1787853143.210370:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 236 00000100:00100000:1.0:1787853143.210383:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493ffa2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+29:11659:x1874699526179840:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:1.0:1787853143.210416:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853143.210444:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad000/0x710df789068e714a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c50793899de expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853143.218395:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ada00/0x710df789068e7151 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853143.218428:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ada00/0x710df789068e7151 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853143.218456:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ada00/0x710df789068e7151 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787853143.218477:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1787853143.218807:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad000/0x710df789068e714a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793899de expref: 32 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853143.218848:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ada00/0x710df789068e7151 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793899de expref: 31 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853143.218861:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8f4910aab000) 00010000:00010000:1.0:1787853143.218865:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787853143.218869:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f492a8ada00, rc 0) 00000100:00100000:1.0:1787853143.218985:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493ffa2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+31:11659:x1874699526179840:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 8603us (8888us total) trans 4294967519 rc 0/0 00000100:00100000:1.0:1787853143.218997:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 236 00000100:00100000:3.0:1787853143.238483:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853143.238536:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526179968 00000100:00100000:3.0:1787853143.238548:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526179968 00000100:00100000:3.0:1787853143.238642:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 237 00000100:00100000:3.0:1787853143.238655:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493ffa3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+31:11659:x1874699526179968:12345-192.168.204.1@tcp:54:lfs.0 00010000:00010000:3.0:1787853143.238748:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21c00/0x710df789068e715f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853143.238769:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21c00/0x710df789068e715f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853143.238783:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21c00/0x710df789068e715f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853143.238818:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21c00/0x710df789068e715f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853143.238827:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21c00/0x710df789068e715f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853143.238834:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21c00/0x710df789068e715f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853143.238841:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4921e21c00 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:3.0:1787853143.238846:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21c00/0x710df789068e715f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853143.238872:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21c00/0x710df789068e715f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853143.238887:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8f4910aab000) 00010000:00010000:3.0:1787853143.238890:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787853143.238896:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21c00/0x710df789068e715f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853143.238903:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21c00/0x710df789068e715f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853143.238991:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493ffa3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+31:11659:x1874699526179968:12345-192.168.204.1@tcp:54:lfs.0 Request processed in 338us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853143.239000:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 237 00000100:00100000:2.0:1787853143.411887:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853143.412002:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526180096 00000100:00100000:3.0:1787853143.412026:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526180096 00000100:00100000:3.0:1787853143.412126:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 74 00000100:00100000:3.0:1787853143.412139:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493c5a4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+7:2364:x1874699526180096:12345-192.168.204.1@tcp:101:cat.0 00010000:00010000:3.0:1787853143.412164:0:8463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853143.412194:0:8463:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c881a93d/0x710df789068e7166 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c50793899e5 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787853143.412241:0:8463:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a907954, atime: 0x6a907953, ctime: 0x6a907954, blocks: 0xb 00010000:00010000:3.0:1787853143.412268:0:8463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=462s v=(0 0) 00010000:00010000:3.0:1787853143.412274:0:8463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787853143.412287:0:8463:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c881a93d/0x710df789068e7166 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793899e5 expref: 8 pid: 8463 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853143.412335:0:8463:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c881a93d/0x710df789068e7166 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793899e5 expref: 8 pid: 8463 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853143.412353:0:8463:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4921e20000, rc 0) 00000100:00100000:3.0:1787853143.412439:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493c5a4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+8:2364:x1874699526180096:12345-192.168.204.1@tcp:101:cat.0 Request processed in 304us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853143.412456:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 74 00000100:00080000:2.0:1787853143.412853:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787853143.426623:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853143.429300:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526180224 00000100:00100000:1.0:1787853143.429322:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526180224 00002000:00100000:2.0:1787853143.434401:0:6687:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff8f493ffa3c00 x1874699526180224/t0(0) o3->b1d98f5a-0be0-4f69-83a6-833c935c8205@192.168.204.1@tcp:319/0 lens 488/0 e 0 to 0 dl 1787853154 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787853143.434421:0:6687:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff8f493ffa3c00 with x1874699526180224 ext(0->4095) 00002000:00010000:2.0:1787853143.434430:0:6687:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8f493ffa3c00 00000100:00100000:2.0:1787853143.434868:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 9 00000100:00100000:2.0:1787853143.434883:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493ffa3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+8:2362:x1874699526180224:12345-192.168.204.1@tcp:3:cat.0 00000100:00100000:2.0:1787853143.435184:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493ffa3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+8:2362:x1874699526180224:12345-192.168.204.1@tcp:3:cat.0 Request processed in 304us (8632us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787853143.435194:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 9 00002000:00100000:2.0:1787853143.435203:0:6687:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff8f493ffa3c00 x1874699526180224/t0(0) o3->b1d98f5a-0be0-4f69-83a6-833c935c8205@192.168.204.1@tcp:319/0 lens 488/4536 e 0 to 0 dl 1787853154 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787853143.435246:0:6687:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff8f493ffa3c00 with x1874699526180224 ext(0->4095) 00002000:00010000:2.0:1787853143.435250:0:6687:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8f493ffa3c00 00010000:00010000:3.0:1787853143.855180:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787853143.909517:0:7641:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000001:00080000:3.0:1787853143.909551:0:7641:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000100:00100000:1.0:1787853144.392859:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853144.392907:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853144.392941:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853144.392966:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853144.392993:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853144.393045:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526180608 00000100:00100000:1.0:1787853144.393058:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526180608 00000100:00100000:1.0:1787853144.393126:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526180736 00000100:00100000:1.0:1787853144.393130:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526180736 00000100:00100000:1.0:1787853144.393169:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 109 00000100:00100000:1.0:1787853144.393181:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493ffa70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+8:2362:x1874699526180608:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:1.0:1787853144.393295:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493ffa70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+8:2362:x1874699526180608:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 116us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853144.393304:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 109 00000100:00100000:1.0:1787853144.393324:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 110 00000100:00100000:1.0:1787853144.393347:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493ffa6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+5:2362:x1874699526180736:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:1.0:1787853144.393373:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493ffa6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+5:2362:x1874699526180736:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 28us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853144.393380:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 110 00000100:00100000:1.0:1787853144.393400:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526180864 00000100:00100000:1.0:1787853144.393403:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526180864 00000100:00100000:1.0:1787853144.393435:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526180480 00000100:00100000:1.0:1787853144.393438:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526180480 00000100:00100000:1.0:1787853144.393458:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 181 00000100:00100000:1.0:1787853144.393464:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493ffa6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ea3b4e1-e827-460f-be07-19e86dff3d79+5:2362:x1874699526180864:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:1.0:1787853144.393508:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493ffa6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ea3b4e1-e827-460f-be07-19e86dff3d79+5:2362:x1874699526180864:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 43us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853144.393515:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 181 00000100:00100000:1.0:1787853144.393527:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 182 00000100:00100000:1.0:1787853144.393534:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493ffa5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+31:2362:x1874699526180480:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:1.0:1787853144.393560:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493ffa5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+31:2362:x1874699526180480:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 27us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853144.393567:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 182 00000100:00080000:1.0:1787853144.394441:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787853144.394451:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787853144.396388:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526180352 00000100:00100000:3.0:1787853144.396410:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526180352 00000100:00100000:3.0:1787853144.396507:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 308 00000100:00100000:3.0:1787853144.396519:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4906230450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af755b38-4932-400a-92cc-ddad0ca077a5+13:2362:x1874699526180352:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:3.0:1787853144.396642:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4906230450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af755b38-4932-400a-92cc-ddad0ca077a5+13:2362:x1874699526180352:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 125us (3811us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853144.396649:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 308 00010000:00010000:2.0:1787853144.874654:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853145.903285:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787853145.930366:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967514 is committed 00000001:00080000:0.0:1787853145.930399:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:0.0:1787853145.930414:0:5858:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8f4906401780 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:0.0:1787853145.930420:0:5858:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8f4910fbee00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8f4906401840 00000020:00080000:0.0:1787853145.930424:0:5858:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8f4910fbef00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8f49418ac000 00000020:00080000:0.0:1787853145.930471:0:5858:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:2.0:1787853145.930490:0:5870:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:2.0:1787853145.930761:0:5870:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000001:00080000:1.0:1787853146.402563:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967326 is committed 00000001:00080000:1.0:1787853146.402602:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967325 is committed 00000100:00100000:1.0:1787853146.859917:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f493ffa4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874699552381184:0@lo:400:kworker.0 00000100:00100000:1.0:1787853146.860105:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853146.860208:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787853146.860224:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f493ffa52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1874699552381312:0@lo:400:kworker.0 00000100:00100000:1.0:1787853146.860261:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853146.860307:0:12025:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552381184 00000100:00100000:1.0:1787853146.860317:0:12025:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552381184 00000100:00100000:1.0:1787853146.860398:0:12025:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787853146.860411:0:12025:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4803e64b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3308:x1874699552381184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853146.860489:0:12025:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4803e64b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3308:x1874699552381184:12345-0@lo:400:kworker.0 Request processed in 80us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853146.860499:0:12025:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787853146.860528:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552381312 00000100:00100000:1.0:1787853146.860532:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552381312 00000100:00100000:1.0:1787853146.860565:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1787853146.860602:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4803e661c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874699552381312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853146.860636:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4803e661c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874699552381312:12345-0@lo:400:kworker.0 Request processed in 36us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853146.860643:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00080000:1.0:1787853146.860661:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787853146.860665:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787853146.860707:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f493ffa52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1874699552381312:0@lo:400:kworker.0 00000100:00100000:1.0:1787853146.860717:0:3308:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967326 gen 2 00000004:00080000:1.0:1787853146.860722:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8f493ffa0000, transno 4294967323 00000004:00080000:1.0:1787853146.860732:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8f492eb9a580, transno 4294967324 00000004:00080000:1.0:1787853146.860738:0:3308:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967326 committed transno 4294967326 00000100:00100000:1.0:1787853146.860764:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f493ffa4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874699552381184:0@lo:400:kworker.0 00000100:00100000:0.0:1787853146.861161:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f493ffa7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5d48a955-7010-4118-9c7d-f396984ae1ff:3306:1874699552380928:0@lo:400:kworker.0 00000100:00100000:0.0:1787853146.861218:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853146.861261:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f493ffa61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1874699552381440:0@lo:400:kworker.0 00000100:00100000:0.0:1787853146.861288:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853146.861310:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787853146.861317:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f493ffa7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874699552381056:0@lo:400:kworker.0 00000100:00100000:0.0:1787853146.861340:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853146.861354:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4803e64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552381568:0@lo:400:kworker.0 00000100:00100000:0.0:1787853146.861377:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853146.864339:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552380928 00000100:00100000:1.0:1787853146.864360:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552380928 00000100:00100000:1.0:1787853146.864459:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:1.0:1787853146.864485:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f490621c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+19:3306:x1874699552380928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853146.864646:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f490621c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+19:3306:x1874699552380928:12345-0@lo:400:kworker.0 Request processed in 164us (3427us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853146.864656:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:1.0:1787853146.864706:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552381440 00000100:00100000:1.0:1787853146.864711:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552381440 00000100:00100000:1.0:1787853146.864756:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552381056 00000100:00100000:1.0:1787853146.864760:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552381056 00000100:00100000:1.0:1787853146.864782:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1787853146.864790:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493fe612c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874699552381440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853146.864828:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493fe612c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874699552381440:12345-0@lo:400:kworker.0 Request processed in 39us (3539us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853146.864835:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1787853146.864849:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1787853146.864855:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493fe60f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874699552381056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853146.864888:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493fe60f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874699552381056:12345-0@lo:400:kworker.0 Request processed in 33us (3546us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853146.864894:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1787853146.864921:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552381568 00000100:00100000:1.0:1787853146.864925:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552381568 00000100:00100000:1.0:1787853146.864959:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787853146.864967:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493fe61a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874699552381568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853146.865004:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493fe61a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874699552381568:12345-0@lo:400:kworker.0 Request processed in 38us (3626us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853146.865011:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00080000:1.0:1787853146.865036:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787853146.865042:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787853146.865107:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f493ffa7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874699552381056:0@lo:400:kworker.0 00000100:00100000:1.0:1787853146.865121:0:3306:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:1.0:1787853146.865128:0:3306:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:1.0:1787853146.865154:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8f4941af1e00, transno 4294967310 00000100:00100000:1.0:1787853146.866508:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4803e64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552381568:0@lo:400:kworker.0 00000100:00100000:1.0:1787853146.866556:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f493ffa7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5d48a955-7010-4118-9c7d-f396984ae1ff:3306:1874699552380928:0@lo:400:kworker.0 00000100:00100000:1.0:1787853146.866594:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f493ffa61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1874699552381440:0@lo:400:kworker.0 00010000:00010000:3.0:1787853146.922704:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787853147.375836:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f493ffa12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874699552381696:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787853147.375957:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853147.376064:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552381696 00000100:00100000:3.0:1787853147.376074:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552381696 00000100:00100000:3.0:1787853147.376135:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787853147.376145:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493ffa0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874699552381696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787853147.376207:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787853147.376264:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493ffa0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874699552381696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 119us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853147.376272:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787853147.376330:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f493ffa12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874699552381696:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787853147.378438:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f493c5a6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874699552381824:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787853147.378528:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853147.378637:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552381824 00000100:00100000:3.0:1787853147.378648:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552381824 00000100:00100000:3.0:1787853147.378705:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787853147.378714:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493ffa12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874699552381824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787853147.378761:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 54460416 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787853147.378818:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493ffa12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874699552381824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853147.378825:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787853147.378875:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f493c5a6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874699552381824:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787853147.962126:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853148.969803:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787853149.516091:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853149.516152:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853149.516181:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853149.516219:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526180992 00000100:00100000:1.0:1787853149.516232:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526180992 00000100:00100000:1.0:1787853149.516295:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 310 00000100:00100000:1.0:1787853149.516308:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f490621c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af755b38-4932-400a-92cc-ddad0ca077a5+13:2365:x1874699526180992:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:1.0:1787853149.516416:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f490621c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af755b38-4932-400a-92cc-ddad0ca077a5+13:2365:x1874699526180992:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 111us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853149.516424:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 310 00000100:00100000:1.0:1787853149.516465:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526181120 00000100:00100000:1.0:1787853149.516470:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526181120 00000100:00100000:1.0:1787853149.516513:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 186 00000100:00100000:1.0:1787853149.516521:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4803e64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+18:2364:x1874699526181120:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:1.0:1787853149.516557:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4803e64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+18:2364:x1874699526181120:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 37us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853149.516563:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 186 00000100:00100000:1.0:1787853149.516616:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526181376 00000100:00100000:1.0:1787853149.516630:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526181376 00000100:00100000:1.0:1787853149.516665:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 113 00000100:00100000:1.0:1787853149.516672:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4803e67840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+5:2364:x1874699526181376:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:1.0:1787853149.516702:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4803e67840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b1d98f5a-0be0-4f69-83a6-833c935c8205+5:2364:x1874699526181376:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 31us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853149.516709:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 113 00000100:00080000:1.0:1787853149.516865:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787853149.516872:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787853149.519300:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853149.519362:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853149.519411:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526181504 00000100:00100000:1.0:1787853149.519423:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526181504 00000100:00100000:1.0:1787853149.519498:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 187 00000100:00100000:1.0:1787853149.519509:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4803e670c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ea3b4e1-e827-460f-be07-19e86dff3d79+5:2365:x1874699526181504:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:1.0:1787853149.519857:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4803e670c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ea3b4e1-e827-460f-be07-19e86dff3d79+5:2365:x1874699526181504:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 350us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853149.519867:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 187 00000100:00080000:1.0:1787853149.519898:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787853149.520538:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526181248 00000100:00100000:3.0:1787853149.520548:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526181248 00000100:00100000:3.0:1787853149.520704:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 114 00000100:00100000:3.0:1787853149.520718:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4803e643c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+7:2365:x1874699526181248:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:3.0:1787853149.520848:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4803e643c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+7:2365:x1874699526181248:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 135us (1566us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853149.520857:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 114 00000100:00080000:1.0:1787853149.521000:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787853149.995411:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787853150.450558:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853150.450689:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526181632 00000100:00100000:1.0:1787853150.450702:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526181632 00000100:00100000:1.0:1787853150.450793:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 238 00000100:00100000:1.0:1787853150.450807:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493fe621c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+18:11312:x1874699526181632:12345-192.168.204.1@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1787853150.451004:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493fe621c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+18:11312:x1874699526181632:12345-192.168.204.1@tcp:60:lhsmtool_posix.0 Request processed in 200us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853150.451013:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 238 00000100:00100000:1.0:1787853150.456422:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853150.456565:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526181888 00000100:00100000:0.0:1787853150.456615:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526181888 00000100:00100000:0.0:1787853150.456685:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 65 00000100:00100000:0.0:1787853150.456696:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4803e65680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+18:11312:x1874699526181888:12345-192.168.204.1@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787853150.457384:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4803e65680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+19:11312:x1874699526181888:12345-192.168.204.1@tcp:35:lhsmtool_posix.0 Request processed in 684us (973us total) trans 4294967520 rc 0/0 00000100:00100000:0.0:1787853150.457394:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 65 00000100:00100000:2.0:1787853150.941733:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853150.943820:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526182016 00000100:00100000:1.0:1787853150.943841:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526182016 00000100:00100000:1.0:1787853150.943964:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 239 00000100:00100000:1.0:1787853150.943978:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493c5a6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ea3b4e1-e827-460f-be07-19e86dff3d79+5:12111:x1874699526182016:12345-192.168.204.1@tcp:101:lsof.0 00010000:00010000:1.0:1787853150.944016:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853150.944048:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ac000/0x710df789068e716d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c50793899ec expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853150.944145:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e7174 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853150.944163:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e7174 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853150.944181:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e7174 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787853150.951938:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787853150.951953:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1787853150.952177:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e7174 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853150.952244:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ac000/0x710df789068e716d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793899ec expref: 7 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853150.952271:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e7174 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793899ec expref: 6 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853150.952282:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f4914d11200) 00010000:00010000:1.0:1787853150.952285:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787853150.952301:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f492a8ad200, rc 0) 00000100:00100000:1.0:1787853150.952434:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493c5a6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ea3b4e1-e827-460f-be07-19e86dff3d79+6:12111:x1874699526182016:12345-192.168.204.1@tcp:101:lsof.0 Request processed in 8457us (10713us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853150.952447:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 239 00010000:00010000:0.0:1787853151.017891:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787853151.030688:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:0.0:1787853151.030726:0:5858:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:2.0:1787853151.030802:0:5870:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:2.0:1787853151.030817:0:5870:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:00080000:0.0:1787853151.466060:0:11690:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787853151.466074:0:11690:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787853151.466447:0:11690:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:0.0:1787853151.466455:0:11690:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787853151.978109:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f493fe60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874699552382080:0@lo:400:kworker.0 00000100:00100000:2.0:1787853151.978218:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853151.978305:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f493c58c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874699552382592:0@lo:400:kworker.0 00000100:00100000:0.0:1787853151.978467:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552382080 00000100:00100000:0.0:1787853151.978480:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552382080 00000100:00100000:0.0:1787853151.978546:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1787853151.978598:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f492eb9a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874699552382080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853151.978667:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f492eb9a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874699552382080:12345-0@lo:400:kworker.0 Request processed in 72us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853151.978675:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1787853151.978769:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853151.978837:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f493fe60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874699552382080:0@lo:400:kworker.0 00000100:00100000:2.0:1787853151.978858:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787853151.978866:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f493fe63840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5d48a955-7010-4118-9c7d-f396984ae1ff:3307:1874699552381952:0@lo:400:kworker.0 00000100:00100000:2.0:1787853151.978897:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853151.978923:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f493fe630c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1874699552382464:0@lo:400:kworker.0 00000100:00100000:2.0:1787853151.978948:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853151.978981:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552381952 00000100:00100000:2.0:1787853151.978985:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552381952 00000100:00100000:2.0:1787853151.979017:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:2.0:1787853151.979022:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4906233850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+19:3307:x1874699552381952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853151.979059:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4906233850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+19:3307:x1874699552381952:12345-0@lo:400:kworker.0 Request processed in 37us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853151.979072:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:0.0:1787853151.979614:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552382592 00000100:00100000:0.0:1787853151.979620:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552382592 00000100:00100000:0.0:1787853151.979672:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1787853151.979680:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49216e6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874699552382592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853151.979729:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49216e6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874699552382592:12345-0@lo:400:kworker.0 Request processed in 50us (960us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853151.979736:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1787853151.979800:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552382464 00000100:00100000:0.0:1787853151.979804:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552382464 00000100:00100000:0.0:1787853151.979828:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1787853151.979835:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493fe60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874699552382464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853151.979868:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493fe60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874699552382464:12345-0@lo:400:kworker.0 Request processed in 34us (919us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853151.979873:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1787853151.979917:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f493fe63840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5d48a955-7010-4118-9c7d-f396984ae1ff:3307:1874699552381952:0@lo:400:kworker.0 00000100:00100000:0.0:1787853151.979931:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f493fe630c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1874699552382464:0@lo:400:kworker.0 00000100:00100000:0.0:1787853151.979942:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f493c58c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874699552382592:0@lo:400:kworker.0 00000100:00080000:1.0:1787853151.980179:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787853151.980186:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787853151.980552:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f493fe60b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874699552382208:0@lo:400:kworker.0 00000100:00100000:3.0:1787853151.980652:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853151.980692:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787853151.980701:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f493fe60780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1874699552382336:0@lo:400:kworker.0 00000100:00100000:3.0:1787853151.980726:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853151.980988:0:12025:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552382208 00000100:00100000:1.0:1787853151.980996:0:12025:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552382208 00000100:00100000:1.0:1787853151.981072:0:12025:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1787853151.981082:0:12025:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493ffa0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3308:x1874699552382208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853151.981139:0:12025:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493ffa0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3308:x1874699552382208:12345-0@lo:400:kworker.0 Request processed in 59us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853151.981146:0:12025:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1787853151.981184:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f493fe60b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874699552382208:0@lo:400:kworker.0 00000100:00100000:0.0:1787853151.981387:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552382336 00000100:00100000:0.0:1787853151.981393:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552382336 00000100:00100000:0.0:1787853151.981429:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1787853151.981437:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493ffa0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874699552382336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853151.981492:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493ffa0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874699552382336:12345-0@lo:400:kworker.0 Request processed in 57us (765us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853151.981500:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1787853151.981783:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f493fe60780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1874699552382336:0@lo:400:kworker.0 00000100:00080000:2.0:1787853151.982467:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787853151.982475:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787853152.043235:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787853152.490083:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f493ffa21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874699552382720:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787853152.490189:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853152.490426:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552382720 00000100:00100000:3.0:1787853152.490437:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552382720 00000100:00100000:3.0:1787853152.490514:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787853152.490526:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4803e66940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874699552382720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787853152.490597:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787853152.490661:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4803e66940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874699552382720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 136us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853152.490669:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787853152.490727:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f493ffa21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874699552382720:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787853152.491061:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787853152.491071:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f493fe60780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874699552382848:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787853152.491105:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853152.491188:0:10348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552382848 00000100:00100000:2.0:1787853152.491203:0:10348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552382848 00000100:00100000:2.0:1787853152.491243:0:10348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787853152.491252:0:10348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493ffa21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874699552382848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787853152.491277:0:10348:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 54460416 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787853152.491336:0:10348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493ffa21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874699552382848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853152.491343:0:10348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787853152.491377:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f493fe60780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874699552382848:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787853153.065790:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853154.089807:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787853154.638973:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853154.645476:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853154.645548:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853154.645597:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853154.645630:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853154.645679:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526182144 00000100:00100000:0.0:1787853154.645692:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526182144 00000100:00100000:0.0:1787853154.645757:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 312 00000100:00100000:0.0:1787853154.645769:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f490621e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af755b38-4932-400a-92cc-ddad0ca077a5+13:2363:x1874699526182144:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:0.0:1787853154.645866:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f490621e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af755b38-4932-400a-92cc-ddad0ca077a5+13:2363:x1874699526182144:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 99us (6909us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853154.645873:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 312 00000100:00100000:0.0:1787853154.645934:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526182656 00000100:00100000:0.0:1787853154.645939:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526182656 00000100:00100000:0.0:1787853154.645979:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526182272 00000100:00100000:0.0:1787853154.645982:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526182272 00000100:00100000:0.0:1787853154.646178:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 191 00000100:00100000:0.0:1787853154.646191:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49342370c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ea3b4e1-e827-460f-be07-19e86dff3d79+6:2363:x1874699526182656:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:0.0:1787853154.646240:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49342370c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ea3b4e1-e827-460f-be07-19e86dff3d79+6:2363:x1874699526182656:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 53us (691us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853154.646247:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 191 00000100:00100000:0.0:1787853154.646263:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 192 00000100:00100000:0.0:1787853154.646299:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4934234000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+18:2363:x1874699526182272:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:0.0:1787853154.646336:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4934234000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+18:2363:x1874699526182272:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 40us (739us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853154.646343:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 192 00000100:00100000:0.0:1787853154.646368:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526182400 00000100:00100000:0.0:1787853154.646372:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526182400 00000100:00100000:0.0:1787853154.646403:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526182528 00000100:00100000:0.0:1787853154.646407:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526182528 00000100:00100000:0.0:1787853154.646431:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 117 00000100:00100000:0.0:1787853154.646438:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493c58c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+7:2363:x1874699526182400:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:0.0:1787853154.646469:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493c58c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+7:2363:x1874699526182400:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 32us (1013us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853154.646476:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 117 00000100:00100000:0.0:1787853154.646488:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 118 00000100:00100000:0.0:1787853154.646495:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4934234b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+5:2363:x1874699526182528:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:0.0:1787853154.646520:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4934234b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b1d98f5a-0be0-4f69-83a6-833c935c8205+5:2363:x1874699526182528:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 26us (889us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853154.646526:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 118 00000100:00080000:0.0:1787853154.646726:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787853154.646731:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787853154.646734:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:1.0:1787853154.956283:0:12726:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 13:52:33 (1787853153) 00010000:00010000:0.0:1787853155.114281:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853156.139593:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787853157.098863:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4803e66d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874699552383232:0@lo:400:kworker.0 00000100:00100000:1.0:1787853157.098944:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853157.099066:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4803e66580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874699552383104:0@lo:400:kworker.0 00000100:00100000:0.0:1787853157.099119:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4803e65e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5d48a955-7010-4118-9c7d-f396984ae1ff:3306:1874699552382976:0@lo:400:kworker.0 00000100:00100000:2.0:1787853157.099686:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853157.099743:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4803e64780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874699552383616:0@lo:400:kworker.0 00000100:00100000:2.0:1787853157.099772:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853157.101175:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853157.101238:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4803e67c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1874699552383488:0@lo:400:kworker.0 00000100:00100000:0.0:1787853157.101288:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853157.101335:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4803e67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1874699552383360:0@lo:400:kworker.0 00000100:00100000:0.0:1787853157.101362:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853157.101396:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552383104 00000100:00100000:0.0:1787853157.101405:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552383104 00000100:00100000:0.0:1787853157.101448:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552383488 00000100:00100000:0.0:1787853157.101451:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552383488 00000100:00100000:0.0:1787853157.101473:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552383360 00000100:00100000:0.0:1787853157.101476:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552383360 00000100:00100000:0.0:1787853157.101492:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1787853157.101500:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493fe630c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874699552383104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853157.101556:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493fe630c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874699552383104:12345-0@lo:400:kworker.0 Request processed in 57us (1871us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853157.101564:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1787853157.101598:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1787853157.101605:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4908ca4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874699552383488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853157.101640:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4908ca4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874699552383488:12345-0@lo:400:kworker.0 Request processed in 36us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853157.101647:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1787853157.101660:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1787853157.101666:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493bee9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874699552383360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853157.101697:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493bee9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874699552383360:12345-0@lo:400:kworker.0 Request processed in 32us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853157.101703:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1787853157.101722:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552383232 00000100:00100000:0.0:1787853157.101726:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552383232 00000100:00100000:0.0:1787853157.101752:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552383616 00000100:00100000:0.0:1787853157.101762:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552383616 00000100:00100000:0.0:1787853157.101785:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1787853157.101792:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4803e652c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1874699552383232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853157.101826:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4803e652c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1874699552383232:12345-0@lo:400:kworker.0 Request processed in 35us (2883us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853157.102717:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4803e66d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874699552383232:0@lo:400:kworker.0 00000100:00100000:0.0:1787853157.102951:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1787853157.104662:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1787853157.104681:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493fe63840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1874699552383616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853157.104766:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493fe63840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1874699552383616:12345-0@lo:400:kworker.0 Request processed in 94us (4993us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853157.104783:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1787853157.105243:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552382976 00000100:00100000:0.0:1787853157.105251:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552382976 00000100:00100000:0.0:1787853157.105298:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:0.0:1787853157.105306:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f490621f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+19:3306:x1874699552382976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853157.105345:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f490621f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d48a955-7010-4118-9c7d-f396984ae1ff+19:3306:x1874699552382976:12345-0@lo:400:kworker.0 Request processed in 40us (4175us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853157.105351:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00080000:0.0:1787853157.105393:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787853157.105398:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787853157.105402:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787853157.105437:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4803e67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1874699552383360:0@lo:400:kworker.0 00000100:00100000:0.0:1787853157.105502:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4803e66580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874699552383104:0@lo:400:kworker.0 00000100:00100000:0.0:1787853157.105514:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4803e64780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874699552383616:0@lo:400:kworker.0 00000100:00100000:0.0:1787853157.105547:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4803e65e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5d48a955-7010-4118-9c7d-f396984ae1ff:3306:1874699552382976:0@lo:400:kworker.0 00000100:00100000:0.0:1787853157.105560:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4803e67c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1874699552383488:0@lo:400:kworker.0 00010000:00010000:0.0:1787853157.163337:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787853157.615815:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787853157.615839:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f48039f03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874699552383744:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787853157.615907:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853157.615983:0:10348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552383744 00000100:00100000:0.0:1787853157.615991:0:10348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552383744 00000100:00100000:0.0:1787853157.616052:0:10348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787853157.616061:0:10348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4803aaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874699552383744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787853157.616097:0:10348:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 54460416 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787853157.616142:0:10348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4803aaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874699552383744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853157.616150:0:10348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787853157.616200:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f48039f03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874699552383744:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787853157.616786:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787853157.616796:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f48039f03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874699552383872:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787853157.616832:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853157.616895:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552383872 00000100:00100000:0.0:1787853157.616900:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552383872 00000100:00100000:0.0:1787853157.616934:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787853157.616941:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4904cd6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874699552383872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787853157.616965:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787853157.617002:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4904cd6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874699552383872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853157.617008:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787853157.617052:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f48039f03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874699552383872:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787853158.186424:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853159.210027:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787853159.752986:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853159.753098:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853159.753141:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853159.753214:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853159.753322:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853159.753380:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526182912 00000100:00100000:2.0:1787853159.753393:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526182912 00000100:00100000:2.0:1787853159.753454:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526183296 00000100:00100000:2.0:1787853159.753466:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526183296 00000100:00100000:2.0:1787853159.753509:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 196 00000100:00100000:2.0:1787853159.753519:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493fe60780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+18:2364:x1874699526182912:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:2.0:1787853159.753642:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493fe60780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+18:2364:x1874699526182912:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 124us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853159.753650:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 196 00000100:00100000:2.0:1787853159.753669:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 197 00000100:00100000:2.0:1787853159.753676:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f492eb8ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ea3b4e1-e827-460f-be07-19e86dff3d79+6:2365:x1874699526183296:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:2.0:1787853159.753703:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f492eb8ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ea3b4e1-e827-460f-be07-19e86dff3d79+6:2365:x1874699526183296:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 27us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853159.753710:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 197 00000100:00080000:2.0:1787853159.753741:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787853159.755259:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526183040 00000100:00100000:1.0:1787853159.755272:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526183040 00000100:00100000:1.0:1787853159.755352:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526183168 00000100:00100000:1.0:1787853159.755356:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526183168 00000100:00100000:1.0:1787853159.755389:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 121 00000100:00100000:1.0:1787853159.755398:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493fe60b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+7:2364:x1874699526183040:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:1.0:1787853159.755461:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493fe60b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+7:2364:x1874699526183040:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 66us (2363us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853159.755468:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 121 00000100:00100000:1.0:1787853159.755483:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 75 00000100:00100000:1.0:1787853159.755490:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f492eb8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+5:2361:x1874699526183168:12345-192.168.204.1@tcp:9:kworker.0 00000020:00000080:1.0:1787853159.755511:0:6681:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x710df789068e64c4 00000100:00080000:1.0:1787853159.755520:0:6681:0:(import.c:65:import_set_state_nolock()) ffff8f4906524800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787853159.755557:0:6681:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00010000:00010000:3.0:1787853159.755687:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787853159.755839:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f492eb8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+2:2361:x1874699526183168:12345-192.168.204.1@tcp:9:kworker.0 Request processed in 347us (2515us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853159.755845:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 75 00000100:00080000:2.0:1787853159.758871:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787853159.758885:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787853159.769867:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526182784 00000100:00100000:0.0:1787853159.769883:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526182784 00000100:00100000:0.0:1787853159.770157:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 314 00000100:00100000:0.0:1787853159.770191:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f490621f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af755b38-4932-400a-92cc-ddad0ca077a5+13:2364:x1874699526182784:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:0.0:1787853159.770295:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f490621f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af755b38-4932-400a-92cc-ddad0ca077a5+13:2364:x1874699526182784:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 116us (17319us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853159.770302:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 314 00000100:00100000:3.0:1787853159.862724:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853159.863551:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526183552 00000100:00100000:0.0:1787853159.863629:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526183552 00000100:00100000:0.0:1787853159.863724:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 66 00000100:00100000:0.0:1787853159.863737:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49418a1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+18:12333:x1874699526183552:12345-192.168.204.1@tcp:35:umount.0 00000100:00100000:1.0:1787853159.864868:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49418a1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+19:12333:x1874699526183552:12345-192.168.204.1@tcp:35:umount.0 Request processed in 1123us (2150us total) trans 4294967521 rc 0/0 00000100:00100000:1.0:1787853159.864897:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 66 00000100:00100000:1.0:1787853159.868367:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853159.869261:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526183808 00000100:00100000:3.0:1787853159.869283:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526183808 00000100:00100000:3.0:1787853159.869386:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 67 00000100:00100000:3.0:1787853159.869399:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4803e64f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+19:12333:x1874699526183808:12345-192.168.204.1@tcp:35:umount.0 00000100:00100000:3.0:1787853159.870644:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4803e64f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+20:12333:x1874699526183808:12345-192.168.204.1@tcp:35:umount.0 Request processed in 1238us (2277us total) trans 4294967522 rc 0/0 00000100:00100000:3.0:1787853159.870659:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 67 00000100:00100000:2.0:1787853159.880195:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853159.883172:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526184064 00000100:00100000:1.0:1787853159.883203:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526184064 00000100:00100000:1.0:1787853159.883353:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 68 00000100:00100000:1.0:1787853159.883366:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f491040b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+20:12333:x1874699526184064:12345-192.168.204.1@tcp:35:umount.0 00000100:00100000:1.0:1787853159.884000:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f491040b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+21:12333:x1874699526184064:12345-192.168.204.1@tcp:35:umount.0 Request processed in 634us (3829us total) trans 4294967523 rc 0/0 00000100:00100000:1.0:1787853159.884010:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 68 00000100:00100000:0.0:1787853159.893971:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853159.894104:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526184320 00000100:00100000:3.0:1787853159.894117:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526184320 00000100:00100000:3.0:1787853159.894244:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 69 00000100:00100000:3.0:1787853159.894257:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f48039f03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+21:12333:x1874699526184320:12345-192.168.204.1@tcp:35:umount.0 00000100:00100000:3.0:1787853159.894978:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f48039f03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b1d98f5a-0be0-4f69-83a6-833c935c8205+22:12333:x1874699526184320:12345-192.168.204.1@tcp:35:umount.0 Request processed in 720us (1021us total) trans 4294967524 rc 0/0 00000100:00100000:3.0:1787853159.894988:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 69 00000100:00100000:2.0:1787853159.900394:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853159.900441:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853159.900625:0:12025:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526185088 00000100:00100000:0.0:1787853159.900638:0:12025:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526185088 00000100:00100000:0.0:1787853159.900702:0:12025:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 76 00000100:00100000:0.0:1787853159.900715:0:12025:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f492eb8bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b1d98f5a-0be0-4f69-83a6-833c935c8205+7:2361:x1874699526185088:12345-192.168.204.1@tcp:9:umount.0 00000020:00000080:0.0:1787853159.900760:0:12025:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x710df789068e6725 00000020:00010000:0.0:1787853159.900774:0:12025:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8f4912455800: total 0 00000100:00080000:0.0:1787853159.900791:0:12025:0:(import.c:65:import_set_state_nolock()) ffff8f4912457000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787853159.900846:0:12025:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967326 00000100:00100000:0.0:1787853159.901225:0:12025:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f492eb8bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b1d98f5a-0be0-4f69-83a6-833c935c8205+5:2361:x1874699526185088:12345-192.168.204.1@tcp:9:umount.0 Request processed in 511us (845us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853159.901234:0:12025:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 76 00000020:00010000:0.0:1787853159.901264:0:5826:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8f4912455800: total 0 00010000:00010000:0.0:1787853159.901285:0:5826:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8f4912455800, canceled 0 locks, left on hash table 2. 00010000:00010000:0.0:1787853159.901363:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff26dc11/0x710df789068e6ac8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389817 expref: 4 pid: 6684 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853159.901400:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c881a93d/0x710df789068e7166 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793899e5 expref: 3 pid: 8463 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853159.901415:0:5826:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8f4912455800, canceled 2 locks, left on hash table 0. 00010000:00010000:0.0:1787853159.901426:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853159.901429:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853159.901446:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787853159.902032:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853159.904132:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853159.904735:0:11175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526184448 00000100:00100000:1.0:1787853159.904750:0:11175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526184448 00000100:00100000:1.0:1787853159.904857:0:11175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526184704 00000100:00100000:1.0:1787853159.904860:0:11175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526184704 00000100:00100000:1.0:1787853159.904890:0:11175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 18 00000100:00100000:1.0:1787853159.904900:0:11175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f492eb88780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:af755b38-4932-400a-92cc-ddad0ca077a5+14:2364:x1874699526184448:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787853159.904930:0:11175:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787853159.904957:0:11175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f49415b9a00/0x710df789068e61ec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389577 expref: 14 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853159.904980:0:11175:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787853159.905052:0:11175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f492eb88780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:af755b38-4932-400a-92cc-ddad0ca077a5+13:2364:x1874699526184448:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 153us (4609us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853159.905060:0:11175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 18 00000100:00100000:1.0:1787853159.905081:0:11175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 19 00000100:00100000:1.0:1787853159.905088:0:11175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4905686050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:af755b38-4932-400a-92cc-ddad0ca077a5+12:2364:x1874699526184704:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787853159.905097:0:11175:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787853159.905106:0:11175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f49415b9400/0x710df789068e6400 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389642 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853159.905116:0:11175:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787853159.905133:0:11175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4905686050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:af755b38-4932-400a-92cc-ddad0ca077a5+11:2364:x1874699526184704:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 47us (3105us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853159.905160:0:11175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 19 00000100:00100000:2.0:1787853159.910041:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853159.910136:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526184576 00000100:00100000:0.0:1787853159.910149:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526184576 00000100:00100000:0.0:1787853159.910238:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 20 00000100:00100000:0.0:1787853159.910249:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f492eb892c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:af755b38-4932-400a-92cc-ddad0ca077a5+11:2364:x1874699526184576:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787853159.910270:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787853159.910295:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f49029cce00/0x710df789068e6152 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c507938953f expref: 11 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853159.910317:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787853159.910377:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f492eb892c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:af755b38-4932-400a-92cc-ddad0ca077a5+10:2364:x1874699526184576:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 131us (6260us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853159.910386:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 20 00000100:00100000:1.0:1787853159.910749:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526186112 00000100:00100000:1.0:1787853159.910755:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526186112 00000100:00100000:1.0:1787853159.910811:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 240 00000100:00100000:1.0:1787853159.910819:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f492eb88f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+22:2361:x1874699526186112:12345-192.168.204.1@tcp:39:umount.0 00000020:00000080:1.0:1787853159.910855:0:5837:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x710df789068e6160 00000020:00010000:1.0:1787853159.910887:0:5837:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8f49079ee000: total 0 00000100:00080000:1.0:1787853159.910893:0:5837:0:(import.c:65:import_set_state_nolock()) ffff8f49079ea000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787853159.910921:0:5837:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000100:00100000:1.0:1787853159.911371:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f492eb88f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1d98f5a-0be0-4f69-83a6-833c935c8205+21:2361:x1874699526186112:12345-192.168.204.1@tcp:39:umount.0 Request processed in 552us (1342us total) trans 4294967525 rc 0/0 00000100:00100000:1.0:1787853159.911380:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 240 00000020:00010000:2.0:1787853159.912023:0:8449:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8f49079ee000: total 0 00010000:00010000:2.0:1787853159.912085:0:8449:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8f49079ee000, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1787853159.912126:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f4914d11200) 00010000:00010000:2.0:1787853159.912130:0:8449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787853159.912139:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad800/0x710df789068e6b2a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389833 expref: 20 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853159.912194:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8f4910aab000) 00010000:00010000:2.0:1787853159.912197:0:8449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787853159.912202:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ada00/0x710df789068e7151 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793899de expref: 19 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853159.912216:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8f491176b200) 00010000:00010000:2.0:1787853159.912219:0:8449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787853159.912223:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ac400/0x710df789068e6a89 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389802 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853159.912234:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8f491176b200) 00010000:00010000:2.0:1787853159.912236:0:8449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787853159.912239:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21200/0x710df789068e6ab3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389810 expref: 17 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853159.912250:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8f4910aab000) 00010000:00010000:2.0:1787853159.912252:0:8449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787853159.912255:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e7127 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793899d0 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853159.912268:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8f4910f92100) 00010000:00010000:2.0:1787853159.912270:0:8449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787853159.912274:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20200/0x710df789068e6e25 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c507938990c expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853159.912286:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8f491176b400) 00010000:00010000:2.0:1787853159.912288:0:8449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787853159.912297:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b7a00/0x710df789068e6787 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c507938973e expref: 14 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853159.912312:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8f4910f92900) 00010000:00010000:2.0:1787853159.912314:0:8449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787853159.912317:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21000/0x710df789068e642a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389650 expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853159.912334:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8f491176b200) 00010000:00010000:2.0:1787853159.912336:0:8449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787853159.912340:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20e00/0x710df789068e69a9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793897ca expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853159.912352:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8f491176b400) 00010000:00010000:2.0:1787853159.912355:0:8449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787853159.912358:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6000/0x710df789068e649a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c507938966c expref: 11 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853159.912373:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8f4910aab000) 00010000:00010000:2.0:1787853159.912375:0:8449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787853159.912378:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b6400/0x710df789068e7047 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389998 expref: 10 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853159.912392:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8f4910f92100) 00010000:00010000:2.0:1787853159.912395:0:8449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787853159.912398:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20a00/0x710df789068e6b46 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c507938983a expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853159.912412:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f4914d11600) 00010000:00010000:2.0:1787853159.912419:0:8449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787853159.912424:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ade00/0x710df789068e6446 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389657 expref: 8 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853159.912437:0:8449:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8f49079ee000, canceled 13 locks, left on hash table 0. 00010000:00010000:2.0:1787853159.912451:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853159.912454:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853159.912456:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787853160.233790:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787853161.223411:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000001:00100000:0.0:1787853161.223433:0:5858:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of b1d98f5a-0be0-4f69-83a6-833c935c8205 00000001:00080000:0.0:1787853161.223440:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:0.0:1787853161.223456:0:5858:0:(genops.c:885:class_export_put()) final put ffff8f49079ee000/b1d98f5a-0be0-4f69-83a6-833c935c8205 00000020:00000080:2.0:1787853161.223849:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff8f49079ee000/b1d98f5a-0be0-4f69-83a6-833c935c8205 for lustre-MDT0000 00000020:00000080:2.0:1787853161.223937:0:475:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f49079ea000 for lustre-MDT0000 00010000:00010000:0.0:1787853161.259116:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787853161.706061:0:11690:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787853161.706074:0:11690:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787853161.706561:0:11690:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:0.0:1787853161.706606:0:11690:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00100000:2.0:1787853161.778419:0:6712:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b1d98f5a-0be0-4f69-83a6-833c935c8205 00000020:00000080:2.0:1787853161.778428:0:6712:0:(genops.c:885:class_export_put()) final put ffff8f4912455800/b1d98f5a-0be0-4f69-83a6-833c935c8205 00000020:00000080:3.0:1787853161.778499:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8f4912455800/b1d98f5a-0be0-4f69-83a6-833c935c8205 for lustre-OST0000 00000020:00000080:3.0:1787853161.778555:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f4912457000 for lustre-OST0000 00000100:00100000:2.0:1787853162.176060:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853162.176528:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526186240 00000100:00100000:1.0:1787853162.176544:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526186240 00000100:00100000:1.0:1787853162.176701:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 21 00000100:00100000:1.0:1787853162.176712:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f492eb89a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af755b38-4932-400a-92cc-ddad0ca077a5+10:2362:x1874699526186240:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787853162.176732:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787853162.176771:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f4900030000/0x710df789068e6232 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c507938958c expref: 10 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853162.176800:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853162.176929:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526186368 00000100:00100000:2.0:1787853162.176935:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526186368 00000100:00100000:2.0:1787853162.176985:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 22 00000100:00100000:2.0:1787853162.176993:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49092bc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:af755b38-4932-400a-92cc-ddad0ca077a5+11:2362:x1874699526186368:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787853162.177001:0:8450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787853162.177011:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f49415b6c00/0x710df789068e63f9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c507938963b expref: 11 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853162.177032:0:8450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787853162.177096:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49092bc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:af755b38-4932-400a-92cc-ddad0ca077a5+10:2362:x1874699526186368:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 104us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853162.177103:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 22 00010000:00010000:1.0:1787853162.177429:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787853162.177465:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f492eb89a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af755b38-4932-400a-92cc-ddad0ca077a5+8:2362:x1874699526186240:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 754us (1421us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853162.177472:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 21 00000100:00100000:0.0:1787853162.187177:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853162.188274:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526186624 00000100:00100000:3.0:1787853162.188287:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526186624 00000100:00100000:3.0:1787853162.188357:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 23 00000100:00100000:3.0:1787853162.188367:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49092bcb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:af755b38-4932-400a-92cc-ddad0ca077a5+8:2362:x1874699526186624:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787853162.188381:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787853162.188400:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f4900030c00/0x710df789068e6239 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793895b6 expref: 8 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853162.188418:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787853162.192835:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49092bcb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:af755b38-4932-400a-92cc-ddad0ca077a5+7:2362:x1874699526186624:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 4450us (5649us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853162.192852:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 23 00000100:00100000:0.0:1787853162.197600:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853162.198486:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526186752 00000100:00100000:3.0:1787853162.198514:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526186752 00000100:00100000:3.0:1787853162.198628:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 241 00000100:00100000:3.0:1787853162.198639:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49092be1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ea3b4e1-e827-460f-be07-19e86dff3d79+6:2361:x1874699526186752:12345-192.168.204.1@tcp:39:umount.0 00000020:00000080:3.0:1787853162.198692:0:8462:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x710df789068e6247 00000020:00010000:3.0:1787853162.198702:0:8462:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8f493fd01000: total 0 00000100:00080000:3.0:1787853162.198707:0:8462:0:(import.c:65:import_set_state_nolock()) ffff8f493fd03000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787853162.198754:0:8462:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:3.0:1787853162.199184:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49092be1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ea3b4e1-e827-460f-be07-19e86dff3d79+5:2361:x1874699526186752:12345-192.168.204.1@tcp:39:umount.0 Request processed in 546us (1618us total) trans 4294967526 rc 0/0 00000100:00100000:3.0:1787853162.199193:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 241 00000020:00010000:3.0:1787853162.199222:0:8449:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8f493fd01000: total 0 00010000:00010000:3.0:1787853162.199225:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787853162.199260:0:8449:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8f493fd01000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1787853162.199294:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f4914d11200) 00010000:00010000:3.0:1787853162.199298:0:8449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787853162.199306:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f492a8ad200/0x710df789068e7174 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c50793899ec expref: 4 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853162.199331:0:8449:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8f493fd01000, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1787853162.199341:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787853162.199342:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787853162.199344:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787853162.200614:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787853162.220562:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f492eb8b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1874699552384384:0@lo:400:kworker.0 00000100:00100000:2.0:1787853162.220656:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853162.220755:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787853162.220762:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f492eb8a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874699552384256:0@lo:400:kworker.0 00000100:00100000:2.0:1787853162.220791:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853162.221179:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552384384 00000100:00100000:1.0:1787853162.221187:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552384384 00000100:00100000:1.0:1787853162.221263:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1787853162.221274:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f492eb89680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874699552384384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853162.221335:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f492eb89680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874699552384384:12345-0@lo:400:kworker.0 Request processed in 64us (679us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853162.221342:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1787853162.221389:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f492eb8b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1874699552384384:0@lo:400:kworker.0 00000100:00100000:3.0:1787853162.221642:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f492eb88b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874699552384128:0@lo:400:kworker.0 00000100:00100000:3.0:1787853162.221674:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853162.221697:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f492eb8b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874699552384640:0@lo:400:kworker.0 00000100:00100000:3.0:1787853162.221751:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853162.221786:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787853162.221792:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f492eb88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5d48a955-7010-4118-9c7d-f396984ae1ff:3307:1874699552384000:0@lo:400:kworker.0 00000100:00100000:3.0:1787853162.221830:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853162.221856:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f492eb883c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1874699552384512:0@lo:400:kworker.0 00000100:00100000:3.0:1787853162.221876:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853162.221906:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552384256 00000100:00100000:3.0:1787853162.221910:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552384256 00000100:00100000:3.0:1787853162.222013:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552384640 00000100:00100000:3.0:1787853162.222016:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552384640 00000100:00100000:3.0:1787853162.222211:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1787853162.222219:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f492eb8a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1874699552384256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853162.222265:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f492eb8a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1874699552384256:12345-0@lo:400:kworker.0 Request processed in 46us (1473us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853162.222272:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1787853162.222286:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1787853162.222291:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49418a1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1874699552384640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853162.222323:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49418a1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1874699552384640:12345-0@lo:400:kworker.0 Request processed in 32us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853162.222328:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1787853162.222353:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552384000 00000100:00100000:3.0:1787853162.222357:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552384000 00000100:00100000:3.0:1787853162.222381:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:3.0:1787853162.222387:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f490621d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+19:3307:x1874699552384000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853162.222416:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f490621d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d48a955-7010-4118-9c7d-f396984ae1ff+19:3307:x1874699552384000:12345-0@lo:400:kworker.0 Request processed in 29us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853162.222421:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:3.0:1787853162.222450:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552384128 00000100:00100000:3.0:1787853162.222454:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552384128 00000100:00100000:3.0:1787853162.222472:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552384512 00000100:00100000:3.0:1787853162.222484:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552384512 00000100:00100000:3.0:1787853162.222503:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1787853162.222509:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49418a1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874699552384128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853162.222539:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49418a1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874699552384128:12345-0@lo:400:kworker.0 Request processed in 31us (865us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853162.222545:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1787853162.222554:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1787853162.222560:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49341170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874699552384512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853162.222616:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49341170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874699552384512:12345-0@lo:400:kworker.0 Request processed in 56us (738us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853162.222621:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1787853162.222650:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f492eb88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5d48a955-7010-4118-9c7d-f396984ae1ff:3307:1874699552384000:0@lo:400:kworker.0 00000100:00100000:3.0:1787853162.222663:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f492eb883c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1874699552384512:0@lo:400:kworker.0 00000100:00100000:3.0:1787853162.222671:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f492eb88b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874699552384128:0@lo:400:kworker.0 00000100:00100000:3.0:1787853162.222678:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f492eb8b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874699552384640:0@lo:400:kworker.0 00000100:00100000:3.0:1787853162.222737:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853162.224552:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f492eb8a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874699552384256:0@lo:400:kworker.0 00000100:00100000:0.0:1787853162.224660:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526187008 00000100:00100000:0.0:1787853162.224666:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526187008 00000100:00100000:0.0:1787853162.224704:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 316 00000100:00100000:0.0:1787853162.224756:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f490621fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af755b38-4932-400a-92cc-ddad0ca077a5+7:2361:x1874699526187008:12345-192.168.204.1@tcp:251:umount.0 00000020:00000080:0.0:1787853162.224811:0:5831:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x710df789068e613d 00000020:00010000:0.0:1787853162.224821:0:5831:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8f493fd06000: total 0 00000100:00080000:0.0:1787853162.224826:0:5831:0:(import.c:65:import_set_state_nolock()) ffff8f493fd05800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1787853162.224903:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f490621fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af755b38-4932-400a-92cc-ddad0ca077a5+3:2361:x1874699526187008:12345-192.168.204.1@tcp:251:umount.0 Request processed in 149us (2167us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853162.224911:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 316 00000020:00010000:1.0:1787853162.225156:0:5825:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8f493fd06000: total 0 00010000:00010000:1.0:1787853162.225198:0:5825:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8f493fd06000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1787853162.225233:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f4900031600/0x710df789068e61f3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c507938957e expref: 2 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853162.225247:0:5825:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8f493fd06000, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1787853162.225255:0:5825:0:(genops.c:885:class_export_put()) final put ffff8f493fd06000/af755b38-4932-400a-92cc-ddad0ca077a5 00010000:00010000:1.0:1787853162.225268:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853162.225270:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853162.225271:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787853162.225665:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787853162.225671:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787853162.225674:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:2.0:1787853162.225683:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff8f493fd06000/af755b38-4932-400a-92cc-ddad0ca077a5 for MGS 00000020:00000080:2.0:1787853162.225727:0:475:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f493fd05800 for MGS 00010000:00010000:0.0:1787853162.281944:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787853162.730708:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49092bf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874699552384768:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787853162.730781:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853162.730898:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787853162.730905:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4934117480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874699552384896:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787853162.730931:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853162.731273:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552384768 00000100:00100000:0.0:1787853162.731282:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552384768 00000100:00100000:0.0:1787853162.731379:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552384896 00000100:00100000:0.0:1787853162.731383:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552384896 00000100:00100000:3.0:1787853162.731419:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787853162.731430:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4803e64f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874699552384768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787853162.731466:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787853162.731517:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4803e64f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874699552384768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (735us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853162.731524:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787853162.731544:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787853162.731551:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4803e65a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874699552384896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787853162.731604:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787853162.731631:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4803e65a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874699552384896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (699us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853162.731637:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787853162.731878:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4934117480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874699552384896:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787853162.731890:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49092bf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874699552384768:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787853163.305738:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787853164.317242:0:12926:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00010000:00010000:1.0:1787853164.342305:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787853164.348873:0:12926:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1787853164.348925:0:12926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f492a8aca00/0x710df789068e61c2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e61c9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853164.348941:0:12926:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f492a8aca00/0x710df789068e61c2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x710df789068e61c9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853164.348949:0:12926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f492a8aca00/0x710df789068e61c2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x710df789068e61c9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853164.348957:0:12926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.101@tcp lock: ffff8f492a8aca00/0x710df789068e61c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x710df789068e61c9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853164.348978:0:12926:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787853164.348985:0:12926:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1787853164.349009:0:12926:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787853164.349014:0:12926:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787853164.349030:0:12926:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787853164.349058:0:12926:0:(import.c:65:import_set_state_nolock()) ffff8f493410b800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1787853164.349243:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787853164.349257:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.101@tcp lock: ffff8f492a8aca00/0x710df789068e61c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x710df789068e61c9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853164.349265:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f492a8aca00 already unused, calling callback (ffffffffc1b55c20) 10000000:00010000:1.0:1787853164.349268:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.101@tcp lock: ffff8f492a8aca00/0x710df789068e61c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x710df789068e61c9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853164.349278:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.101@tcp lock: ffff8f492a8aca00/0x710df789068e61c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x710df789068e61c9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787853164.349286:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.101@tcp lock: ffff8f492a8aca00/0x710df789068e61c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x710df789068e61c9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787853164.349292:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787853164.349295:0:5826:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1787853164.349297:0:5826:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1787853164.349325:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.101@tcp lock: ffff8f492a8aca00/0x710df789068e61c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x710df789068e61c9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853164.349332:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787853164.349360:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.101@tcp lock: ffff8f492a8aca00/0x710df789068e61c2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x710df789068e61c9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853164.349367:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.101@tcp lock: ffff8f492a8aca00/0x710df789068e61c2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x710df789068e61c9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853164.349378:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853164.349380:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853164.349382:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787853164.349459:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787853164.349480:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4803e67c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5d48a955-7010-4118-9c7d-f396984ae1ff:3307:1874699552385152:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787853164.349564:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853164.349665:0:11175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552385152 00000100:00100000:1.0:1787853164.349672:0:11175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552385152 00000100:00100000:1.0:1787853164.349741:0:11175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787853164.349751:0:11175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4803e65e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5d48a955-7010-4118-9c7d-f396984ae1ff+19:3307:x1874699552385152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787853164.349765:0:11175:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787853164.349781:0:11175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f4921e20600/0x710df789068e61c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x710df789068e61c2 expref: 19 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853164.349796:0:11175:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787853164.349832:0:11175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4803e65e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5d48a955-7010-4118-9c7d-f396984ae1ff+18:3307:x1874699552385152:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853164.349839:0:11175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787853164.349878:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4803e67c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5d48a955-7010-4118-9c7d-f396984ae1ff:3307:1874699552385152:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787853164.350034:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49092bc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874699552385024:0@lo:39:umount.0 00000100:00100000:3.0:1787853164.350068:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853164.350139:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552385024 00000100:00100000:1.0:1787853164.350143:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552385024 00000100:00100000:1.0:1787853164.350212:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1787853164.350220:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4934116580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874699552385024:12345-0@lo:39:umount.0 00000020:00000080:1.0:1787853164.350244:0:5836:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x710df789068e5f68 00000100:00080000:1.0:1787853164.350253:0:5836:0:(import.c:65:import_set_state_nolock()) ffff8f4941425000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1787853164.350315:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4934116580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3305:x1874699552385024:12345-0@lo:39:umount.0 Request processed in 97us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853164.350322:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:1.0:1787853164.350328:0:5836:0:(genops.c:885:class_export_put()) final put ffff8f4941423000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:0.0:1787853164.350376:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787853164.351011:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8f493410b800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1787853164.351022:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49092bc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874699552385024:0@lo:39:umount.0 00000100:00080000:0.0:1787853164.351136:0:12926:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787853164.351139:0:12926:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787853164.351143:0:12926:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1787853164.352045:0:12926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f4921e21400/0x710df789068e61d0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e61d7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853164.352058:0:12926:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f4921e21400/0x710df789068e61d0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x710df789068e61d7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853164.352065:0:12926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f4921e21400/0x710df789068e61d0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x710df789068e61d7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853164.352072:0:12926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.101@tcp lock: ffff8f4921e21400/0x710df789068e61d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x710df789068e61d7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853164.352104:0:12926:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787853164.352111:0:12926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f49013fc800/0x710df789068e60f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e60fe expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853164.352118:0:12926:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f49013fc800/0x710df789068e60f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x710df789068e60fe expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853164.352125:0:12926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f49013fc800/0x710df789068e60f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x710df789068e60fe expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853164.352131:0:12926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.101@tcp lock: ffff8f49013fc800/0x710df789068e60f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x710df789068e60fe expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853164.352163:0:12926:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787853164.352182:0:12926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f492a8ac800/0x710df789068e63eb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e63f2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853164.352190:0:12926:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f492a8ac800/0x710df789068e63eb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x710df789068e63f2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853164.352195:0:12926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f492a8ac800/0x710df789068e63eb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x710df789068e63f2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853164.352202:0:12926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.101@tcp lock: ffff8f492a8ac800/0x710df789068e63eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x710df789068e63f2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853164.352213:0:12926:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1787853164.352230:0:8449:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787853164.352235:0:8449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.101@tcp lock: ffff8f4921e21400/0x710df789068e61d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x710df789068e61d7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853164.352243:0:8449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4921e21400 already unused, calling callback (ffffffffc1b55c20) 10000000:00010000:0.0:1787853164.352247:0:8449:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.101@tcp lock: ffff8f4921e21400/0x710df789068e61d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x710df789068e61d7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853164.352255:0:8449:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.101@tcp lock: ffff8f4921e21400/0x710df789068e61d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x710df789068e61d7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787853164.352263:0:8449:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.101@tcp lock: ffff8f4921e21400/0x710df789068e61d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x710df789068e61d7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787853164.352269:0:8449:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787853164.352277:0:8449:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:0.0:1787853164.352308:0:8449:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.101@tcp lock: ffff8f4921e21400/0x710df789068e61d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x710df789068e61d7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853164.352315:0:8449:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787853164.352335:0:8449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.101@tcp lock: ffff8f4921e21400/0x710df789068e61d0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x710df789068e61d7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853164.352342:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.101@tcp lock: ffff8f4921e21400/0x710df789068e61d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x710df789068e61d7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853164.352356:0:8449:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787853164.352359:0:8449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.101@tcp lock: ffff8f49013fc800/0x710df789068e60f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x710df789068e60fe expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853164.352365:0:8449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49013fc800 already unused, calling callback (ffffffffc1b55c20) 10000000:00010000:0.0:1787853164.352368:0:8449:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.101@tcp lock: ffff8f49013fc800/0x710df789068e60f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x710df789068e60fe expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853164.352373:0:8449:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.101@tcp lock: ffff8f49013fc800/0x710df789068e60f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x710df789068e60fe expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787853164.352379:0:8449:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.101@tcp lock: ffff8f49013fc800/0x710df789068e60f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x710df789068e60fe expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787853164.352383:0:8449:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1787853164.352385:0:8449:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1787853164.352387:0:8449:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1787853164.352400:0:8449:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.101@tcp lock: ffff8f49013fc800/0x710df789068e60f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x710df789068e60fe expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853164.352406:0:8449:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787853164.352425:0:8449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.101@tcp lock: ffff8f49013fc800/0x710df789068e60f7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x710df789068e60fe expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853164.352431:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.101@tcp lock: ffff8f49013fc800/0x710df789068e60f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x710df789068e60fe expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853164.352444:0:8449:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787853164.352447:0:8449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.101@tcp lock: ffff8f492a8ac800/0x710df789068e63eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x710df789068e63f2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853164.352452:0:8449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f492a8ac800 already unused, calling callback (ffffffffc1b55c20) 10000000:00010000:0.0:1787853164.352455:0:8449:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.101@tcp lock: ffff8f492a8ac800/0x710df789068e63eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x710df789068e63f2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853164.352461:0:8449:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.101@tcp lock: ffff8f492a8ac800/0x710df789068e63eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x710df789068e63f2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787853164.352466:0:8449:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.101@tcp lock: ffff8f492a8ac800/0x710df789068e63eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x710df789068e63f2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787853164.352471:0:8449:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1787853164.352473:0:8449:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1787853164.352475:0:8449:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1787853164.352488:0:8449:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.101@tcp lock: ffff8f492a8ac800/0x710df789068e63eb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x710df789068e63f2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853164.352493:0:8449:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787853164.352498:0:8449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.101@tcp lock: ffff8f492a8ac800/0x710df789068e63eb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x710df789068e63f2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853164.352505:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.101@tcp lock: ffff8f492a8ac800/0x710df789068e63eb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x710df789068e63f2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853164.352523:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853164.352525:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853164.352527:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787853164.352536:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787853164.352552:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49092bf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5d48a955-7010-4118-9c7d-f396984ae1ff:3306:1874699552385280:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787853164.352640:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853164.352700:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552385280 00000100:00100000:0.0:1787853164.352707:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552385280 00000100:00100000:0.0:1787853164.352753:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787853164.352761:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49092bde00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5d48a955-7010-4118-9c7d-f396984ae1ff+18:3306:x1874699552385280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787853164.352773:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787853164.352787:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f492a8adc00/0x710df789068e61d7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x710df789068e61d0 expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853164.352798:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787853164.352834:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49092bde00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5d48a955-7010-4118-9c7d-f396984ae1ff+17:3306:x1874699552385280:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853164.352840:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787853164.352877:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49092bf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5d48a955-7010-4118-9c7d-f396984ae1ff:3306:1874699552385280:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787853164.352901:0:12926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f49013fca00/0x710df789068e5eb9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e5ec0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853164.352908:0:12926:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f49013fca00/0x710df789068e5eb9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x710df789068e5ec0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853164.352913:0:12926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f49013fca00/0x710df789068e5eb9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x710df789068e5ec0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853164.352925:0:12926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.101@tcp lock: ffff8f49013fca00/0x710df789068e5eb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x710df789068e5ec0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853164.352937:0:12926:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787853164.352940:0:12926:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:0.0:1787853164.352944:0:12926:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:0.0:1787853164.352966:0:8449:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787853164.352969:0:8449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.101@tcp lock: ffff8f49013fca00/0x710df789068e5eb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x710df789068e5ec0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853164.352975:0:8449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49013fca00 already unused, calling callback (ffffffffc1b55c20) 10000000:00010000:0.0:1787853164.352978:0:8449:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.101@tcp lock: ffff8f49013fca00/0x710df789068e5eb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x710df789068e5ec0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853164.352985:0:8449:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.101@tcp lock: ffff8f49013fca00/0x710df789068e5eb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x710df789068e5ec0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787853164.352992:0:8449:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.101@tcp lock: ffff8f49013fca00/0x710df789068e5eb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x710df789068e5ec0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787853164.352997:0:8449:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1787853164.352999:0:8449:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1787853164.353001:0:8449:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1787853164.353015:0:8449:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.101@tcp lock: ffff8f49013fca00/0x710df789068e5eb9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x710df789068e5ec0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853164.353021:0:8449:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787853164.353031:0:8449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.101@tcp lock: ffff8f49013fca00/0x710df789068e5eb9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x710df789068e5ec0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853164.353048:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.101@tcp lock: ffff8f49013fca00/0x710df789068e5eb9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x710df789068e5ec0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853164.353060:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853164.353062:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853164.353063:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787853164.353072:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49092bf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5d48a955-7010-4118-9c7d-f396984ae1ff:3306:1874699552385664:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787853164.353111:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853164.353141:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552385664 00000100:00100000:0.0:1787853164.353144:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552385664 00000100:00100000:0.0:1787853164.353171:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787853164.353178:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4905685c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5d48a955-7010-4118-9c7d-f396984ae1ff+17:3306:x1874699552385664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787853164.353185:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787853164.353193:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f4900031800/0x710df789068e5ec0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x710df789068e5eb9 expref: 17 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853164.353205:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787853164.353231:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4905685c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5d48a955-7010-4118-9c7d-f396984ae1ff+16:3306:x1874699552385664:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853164.353237:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787853164.353287:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49092bf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5d48a955-7010-4118-9c7d-f396984ae1ff:3306:1874699552385664:0@lo:103:ldlm_bl.0 00000020:01000004:0.0:1787853164.353310:0:12926:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1787853164.353314:0:12926:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1787853164.353318:0:12926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787853164.353325:0:12926:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/9 00000020:00080000:0.0:1787853164.353330:0:12926:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8f49415c9800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787853164.353345:0:12926:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8f48011b3000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787853164.353353:0:12926:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff8f493fd01000 0ea3b4e1-e827-460f-be07-19e86dff3d79 192.168.204.1@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787853164.353359:0:12926:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff8f4934848000) has exports, disconnecting them 00000020:00080000:0.0:1787853164.353363:0:12926:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8f49415c9800), last request at 1787853162 00000020:00000080:0.0:1787853164.353370:0:12926:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x710df789068e60bf 00000100:00080000:0.0:1787853164.353396:0:12926:0:(import.c:65:import_set_state_nolock()) ffff8f49415ce000 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1787853164.353434:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1787853164.353447:0:12926:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8f49415c9800): rc 0 00000020:00000080:0.0:1787853164.353450:0:12926:0:(genops.c:885:class_export_put()) final put ffff8f49415c9800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1787853164.353456:0:12926:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8f48011b3000), last request at 1787853162 00000020:00000080:0.0:1787853164.353459:0:12926:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x710df789068e6033 00000100:00080000:0.0:1787853164.353464:0:12926:0:(import.c:65:import_set_state_nolock()) ffff8f48011b5800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1787853164.353475:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1787853164.353482:0:12926:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8f48011b3000): rc 0 00000020:00000080:0.0:1787853164.353484:0:12926:0:(genops.c:885:class_export_put()) final put ffff8f48011b3000/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:0.0:1787853164.353496:0:12926:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffff9a7d0191bae0 00000100:00080000:0.0:1787853164.353518:0:12926:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787853164.353522:0:12926:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967326 gen 3 00000004:00080000:0.0:1787853164.353536:0:12926:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1787853164.353638:0:12926:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1787853164.353652:0:12926:0:(import.c:65:import_set_state_nolock()) ffff8f4906312000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1787853164.353664:0:12926:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787853164.353666:0:12926:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:0.0:1787853164.353675:0:12926:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1787853164.353747:0:12926:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1787853164.353756:0:12926:0:(import.c:65:import_set_state_nolock()) ffff8f4908ed1000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1787853164.353785:0:12926:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8f4934848000) has no exports 00000100:00100000:2.0:1787853164.354061:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49092bf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1874699552385792:0@lo:9:umount.0 00000100:00100000:2.0:1787853164.354120:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853164.354153:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49092bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1874699552385920:0@lo:9:umount.0 00000100:00100000:2.0:1787853164.354178:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853164.354215:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552385792 00000100:00100000:2.0:1787853164.354222:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552385792 00000100:00100000:2.0:1787853164.354265:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552385920 00000100:00100000:2.0:1787853164.354269:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552385920 00000100:00100000:2.0:1787853164.354298:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787853164.354307:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f492eb8a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874699552385792:12345-0@lo:9:umount.0 00000020:00000080:2.0:1787853164.354329:0:6684:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x710df789068e6041 00000100:00080000:2.0:1787853164.354336:0:6684:0:(import.c:65:import_set_state_nolock()) ffff8f48011b4000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787853164.354368:0:6684:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967326 00000100:00100000:2.0:1787853164.354865:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f492eb8a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3305:x1874699552385792:12345-0@lo:9:umount.0 Request processed in 557us (743us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853164.354875:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787853164.354895:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787853164.354902:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f492eb892c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874699552385920:12345-0@lo:9:umount.0 00000020:00000080:2.0:1787853164.354929:0:6684:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x710df789068e6128 00000100:00080000:2.0:1787853164.354937:0:6684:0:(import.c:65:import_set_state_nolock()) ffff8f4941585800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787853164.354954:0:6684:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:2.0:1787853164.355175:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f492eb892c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3305:x1874699552385920:12345-0@lo:9:umount.0 Request processed in 273us (994us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853164.355181:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:2.0:1787853164.355210:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787853164.355214:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787853164.355249:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8f4906312000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1787853164.355263:0:3305:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1787853164.355265:0:3305:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787853164.355269:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49092bf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1874699552385792:0@lo:9:umount.0 00000100:00080000:2.0:1787853164.355282:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8f4908ed1000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1787853164.355290:0:3305:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1787853164.355291:0:3305:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787853164.355294:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49092bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1874699552385920:0@lo:9:umount.0 00000020:00000080:1.0:1787853164.357104:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8f4941423000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1787853164.357162:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8f49415c9800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1787853164.357187:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8f48011b3000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1787853164.357230:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f4941425000 for lustre-MDT0000 00000020:00000080:1.0:1787853164.357235:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f49415ce000 for lustre-MDT0000 00000020:00000080:1.0:1787853164.357238:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f48011b5800 for lustre-MDT0000 00010000:00010000:1.0:1787853164.357249:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787853164.357273:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49092bd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5d48a955-7010-4118-9c7d-f396984ae1ff:3308:1874699552385408:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787853164.357338:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853164.357384:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787853164.357417:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49092be940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5d48a955-7010-4118-9c7d-f396984ae1ff:3308:1874699552385536:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787853164.357442:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853164.357487:0:11175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552385408 00000100:00100000:1.0:1787853164.357496:0:11175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552385408 00010000:00010000:0.0:1787853164.357555:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787853164.357566:0:11175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552385536 00000100:00100000:1.0:1787853164.357602:0:11175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552385536 00000100:00100000:1.0:1787853164.358069:0:11175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787853164.358079:0:11175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4803e67c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5d48a955-7010-4118-9c7d-f396984ae1ff+17:3308:x1874699552385408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787853164.358104:0:11175:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787853164.358123:0:11175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f49421e2e00/0x710df789068e60fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x710df789068e60f7 expref: 17 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853164.358140:0:11175:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787853164.358189:0:11175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4803e67c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5d48a955-7010-4118-9c7d-f396984ae1ff+16:3308:x1874699552385408:12345-0@lo:103:ldlm_bl.0 Request processed in 112us (849us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853164.358197:0:11175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787853164.358216:0:11175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787853164.358224:0:11175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4803e64780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5d48a955-7010-4118-9c7d-f396984ae1ff+15:3308:x1874699552385536:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787853164.358230:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49092bd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5d48a955-7010-4118-9c7d-f396984ae1ff:3308:1874699552385408:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787853164.358234:0:11175:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787853164.358246:0:11175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f492a8ac600/0x710df789068e63f2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x710df789068e63eb expref: 15 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853164.358270:0:11175:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787853164.358308:0:11175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4803e64780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5d48a955-7010-4118-9c7d-f396984ae1ff+14:3308:x1874699552385536:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (865us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853164.358314:0:11175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000001:00100000:3.0:1787853164.358447:0:7641:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b1d98f5a-0be0-4f69-83a6-833c935c8205 00000020:00000080:3.0:1787853164.358458:0:7641:0:(genops.c:885:class_export_put()) final put ffff8f4906525000/b1d98f5a-0be0-4f69-83a6-833c935c8205 00000020:00000080:1.0:1787853164.358606:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff8f4906525000/b1d98f5a-0be0-4f69-83a6-833c935c8205 for lustre-OST0001 00010000:00010000:2.0:1787853164.358664:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787853164.358848:0:475:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f4906524800 for lustre-OST0001 00000100:00100000:0.0:1787853164.358856:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49092be940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5d48a955-7010-4118-9c7d-f396984ae1ff:3308:1874699552385536:0@lo:103:ldlm_bl.0 00000020:00080000:0.0:1787853164.369555:0:12926:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8f4934848000) has no exports 00000020:00000080:0.0:1787853164.419912:0:12926:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x710df789068e5f14 00000020:00000080:0.0:1787853164.420112:0:12926:0:(genops.c:885:class_export_put()) final put ffff8f494129c800/lustre-QMT0000_UUID 00000020:01000000:0.0:1787853164.420171:0:12926:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1787853164.420369:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8f494129c800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1787853164.420400:0:12926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787853164.420411:0:12926:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787853164.420415:0:12926:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff8f493d11cd70) has no exports 00000020:00000080:1.0:1787853164.422733:0:12926:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x710df789068e5f0d 00000020:00000080:1.0:1787853164.422745:0:12926:0:(genops.c:885:class_export_put()) final put ffff8f493d123800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787853164.422815:0:12926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787853164.422826:0:12926:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1787853164.422829:0:12926:0:(genops.c:885:class_export_put()) final put ffff8f4934839800/lustre-QMT0000_UUID 00000020:00000080:1.0:1787853164.422832:0:12926:0:(genops.c:844:class_export_destroy()) destroying export ffff8f4934839800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1787853164.422837:0:12926:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:2.0:1787853164.423011:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8f493d123800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:1.0:1787853165.356933:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853166.389440:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787853166.414935:0:5858:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 0ea3b4e1-e827-460f-be07-19e86dff3d79 00000001:00080000:0.0:1787853166.414949:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:0.0:1787853166.414955:0:5858:0:(genops.c:885:class_export_put()) final put ffff8f493fd01000/0ea3b4e1-e827-460f-be07-19e86dff3d79 00000020:00000080:1.0:1787853166.415028:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff8f493fd01000/0ea3b4e1-e827-460f-be07-19e86dff3d79 for lustre-MDT0000 00000020:00000080:1.0:1787853166.415126:0:475:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f493fd03000 for lustre-MDT0000 00000020:01000000:1.0:1787853166.441729:0:12926:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8f4905760cc0 - data ffff8f491efe2360/ffff8f49057fb000 00000020:01000000:1.0:1787853166.441869:0:12926:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8f4910954a20 - data ffff8f492c3c6510/ffff8f493c158800 00000001:00000004:0.0:1787853166.448528:0:12926:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:3.0:1787853166.513827:0:12926:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787853166.513836:0:12926:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967326 gen 4 00000004:00080000:3.0:1787853166.513861:0:12926:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787853166.513864:0:12926:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1787853166.514327:0:6700:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1787853166.514332:0:6700:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:1.0:1787853166.514342:0:6700:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1787853166.516621:0:12926:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787853166.516629:0:12926:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:3.0:1787853166.516646:0:12926:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787853166.516656:0:12926:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1787853166.517115:0:7878:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1787853166.517120:0:7878:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:0.0:1787853166.517130:0:7878:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1787853166.613959:0:12926:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x710df789068e5edc 00000020:00000080:3.0:1787853166.613972:0:12926:0:(genops.c:885:class_export_put()) final put ffff8f4908ed7800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787853166.615493:0:12926:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x710df789068e5ef1 00000020:00000080:3.0:1787853166.615502:0:12926:0:(genops.c:885:class_export_put()) final put ffff8f4934851000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787853166.615740:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8f4908ed7800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1787853166.615853:0:12926:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1787853166.615861:0:12926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787853166.615871:0:12926:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787853166.615877:0:12926:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff8f490300b3a0) has no exports 00000004:01000000:3.0:1787853166.616056:0:12926:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1787853166.616065:0:12926:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x710df789068e6121 00000020:00000080:3.0:1787853166.616069:0:12926:0:(genops.c:885:class_export_put()) final put ffff8f4941583000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787853166.616358:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8f4934851000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1787853166.616425:0:12926:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1787853166.616429:0:12926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787853166.616436:0:12926:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787853166.616439:0:12926:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff8f493ffe33a0) has no exports 00000020:00000080:3.0:1787853166.616444:0:12926:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x710df789068e611a 00000020:00000080:3.0:1787853166.616449:0:12926:0:(genops.c:885:class_export_put()) final put ffff8f493dc04800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787853166.616467:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8f4941583000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:3.0:1787853166.616907:0:12926:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1787853166.616912:0:12926:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787853166.616916:0:12926:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:3.0:1787853166.616921:0:12926:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787853166.616923:0:12926:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787853166.617068:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8f493dc04800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787853166.617149:0:12926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787853166.617157:0:12926:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787853166.617162:0:12926:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x710df789068e5fbc 00000020:00000080:3.0:1787853166.617167:0:12926:0:(genops.c:885:class_export_put()) final put ffff8f4906312800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787853166.617186:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f4908ed1000 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1787853166.617191:0:36:0:(genops.c:885:class_export_put()) final put ffff8f4941581800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787853166.617193:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8f4941581800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1787853166.617197:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1787853166.617421:0:12926:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1787853166.617426:0:12926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787853166.617431:0:12926:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787853166.617433:0:12926:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff8f49348499d0) has no exports 00000020:00000080:3.0:1787853166.617438:0:12926:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x710df789068e5fb5 00000020:00000080:3.0:1787853166.617442:0:12926:0:(genops.c:885:class_export_put()) final put ffff8f4906310800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787853166.617462:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8f4906312800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00010000:01000000:3.0:1787853166.617979:0:12926:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1787853166.617983:0:12926:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787853166.617986:0:12926:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967326 gen 5 00000004:00080000:3.0:1787853166.617989:0:12926:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787853166.617991:0:12926:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787853166.618956:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8f4906310800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787853166.620015:0:12926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787853166.620029:0:12926:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787853166.620098:0:12926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787853166.620103:0:12926:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787853166.620109:0:12926:0:(genops.c:885:class_export_put()) final put ffff8f4908ed6000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787853166.620112:0:12926:0:(genops.c:844:class_export_destroy()) destroying export ffff8f4908ed6000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1787853166.620131:0:12926:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787853166.620328:0:12926:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x710df789068e5ef8 00000020:00000080:3.0:1787853166.620337:0:12926:0:(genops.c:885:class_export_put()) final put ffff8f4934853800/lustre-MDD0000_UUID 00000020:00000080:0.0:1787853166.620365:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f4906312000 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1787853166.620371:0:36:0:(genops.c:885:class_export_put()) final put ffff8f4906315800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787853166.620373:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8f4906315800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1787853166.620378:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1787853166.620528:0:12926:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:3.0:1787853166.620533:0:12926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787853166.620538:0:12926:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787853166.620542:0:12926:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff8f493484cd70) has no exports 00000020:00000080:3.0:1787853166.620564:0:12926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787853166.621027:0:12926:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:3.0:1787853166.621034:0:12926:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x710df789068e5eff 00000020:00000080:3.0:1787853166.621290:0:12926:0:(genops.c:885:class_export_put()) final put ffff8f4934850000/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1787853166.621305:0:12926:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f492abd6000 from lustre-MDT0000, refs=3 00000020:01000004:3.0:1787853166.621309:0:12926:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f492abd6000 3 00000020:01000004:3.0:1787853166.621312:0:12926:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8f492abd6000 from lustre-MDT0000 00000020:00000080:3.0:1787853166.621336:0:12926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787853166.621341:0:12926:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:3.0:1787853166.621343:0:12926:0:(genops.c:885:class_export_put()) final put ffff8f4908ed6800/lustre-MDT0000_UUID 00000020:00000080:3.0:1787853166.621345:0:12926:0:(genops.c:844:class_export_destroy()) destroying export ffff8f4908ed6800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:3.0:1787853166.621353:0:12926:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:3.0:1787853166.621407:0:12926:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:3.0:1787853166.621411:0:12926:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:3.0:1787853166.621414:0:12926:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:3.0:1787853166.621417:0:12926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787853166.621420:0:12926:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787853166.621428:0:12926:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8f4921e47000 5d48a955-7010-4118-9c7d-f396984ae1ff 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787853166.621433:0:12926:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff8f4903008000) has exports, disconnecting them 00000020:00080000:3.0:1787853166.621444:0:12926:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8f4921e47000), last request at 1787852899 00000020:00000080:3.0:1787853166.621465:0:12926:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x710df789068e5e9d 00000020:00010000:3.0:1787853166.621469:0:12926:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8f4921e47000: total 2 00000100:00080000:3.0:1787853166.621473:0:12926:0:(import.c:65:import_set_state_nolock()) ffff8f4921e42800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1787853166.621487:0:12926:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8f4921e47000): rc 0 00000020:00080000:3.0:1787853166.621490:0:12926:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff8f4903008000) has no exports 00000100:00100000:3.0:1787853166.621562:0:5829:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff8f49143ea000:5829] 0 exiting: rc = 1 00000100:00100000:0.0:1787853166.621639:0:5831:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff8f4912b6ea00:5831] 2 exiting: rc = 0 00000020:00010000:1.0:1787853166.621715:0:5825:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8f4921e47000: total 2 00010000:00010000:1.0:1787853166.621759:0:5825:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8f4921e47000, canceled 0 locks, left on hash table 8. 00000020:00000080:0.0:1787853166.621768:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8f4934853800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1787853166.621774:0:36:0:(genops.c:885:class_export_put()) final put ffff8f4908ed7000/lustre-MDD0000_UUID 00000020:00000080:0.0:1787853166.621777:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8f4908ed7000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1787853166.621784:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00010000:00010000:1.0:1787853166.621787:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f49415b9200/0x710df789068e63d6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x710df789068e63cf expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853166.621803:0:5830:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff8f493981f600:5830] 1 exiting: rc = 0 00010000:00010000:1.0:1787853166.621807:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f492a8ac200/0x710df789068e63e4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x710df789068e63dd expref: 8 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853166.621825:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f4900030a00/0x710df789068e5fe6 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x710df789068e5fdf expref: 7 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853166.621845:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f49415b8e00/0x710df789068e61e5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x710df789068e61de expref: 6 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853166.621859:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f4921e21e00/0x710df789068e6191 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x710df789068e618a expref: 5 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853166.621870:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f49415b9800/0x710df789068e619f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x710df789068e6198 expref: 4 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853166.621885:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f49415b8400/0x710df789068e61bb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x710df789068e61b4 expref: 3 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853166.621888:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:1.0:1787853166.621903:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f49415b9000/0x710df789068e61ad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x710df789068e61a6 expref: 2 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853166.621905:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.621921:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.621932:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:1.0:1787853166.621937:0:5825:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8f4921e47000, canceled 8 locks, left on hash table 0. 00000100:00100000:3.0:1787853166.621944:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.621958:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1787853166.621964:0:5825:0:(genops.c:885:class_export_put()) final put ffff8f4921e47000/5d48a955-7010-4118-9c7d-f396984ae1ff 00000100:00100000:3.0:1787853166.621973:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:1.0:1787853166.621981:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787853166.621986:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:1.0:1787853166.621987:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853166.621992:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787853166.621997:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.622008:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.622018:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.622026:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.622034:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.622041:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.622066:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.622074:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.622094:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.622104:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1787853166.622109:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8f4934850000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:3.0:1787853166.622114:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1787853166.622120:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8f4921e47000/5d48a955-7010-4118-9c7d-f396984ae1ff for MGS 00000100:00100000:3.0:1787853166.622127:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.622137:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.622144:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.622158:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1787853166.622163:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f4921e42800 for MGS 00000100:00100000:3.0:1787853166.622171:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.622182:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.622192:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.622200:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.622205:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.622212:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.622218:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.622224:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.622230:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.622236:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.622250:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.622260:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.622266:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.622272:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.622279:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.622286:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.622293:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.622301:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.622307:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.622313:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.622319:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.622327:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.622335:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.622341:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.622347:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.622354:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.622360:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.622367:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.622374:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.622382:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.622388:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.622394:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.622401:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.622409:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.622416:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.622424:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.622432:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.622443:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.622454:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.622463:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.622468:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:3.0:1787853166.622930:0:12926:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787853166.622941:0:12926:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:3.0:1787853166.624338:0:12926:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8f493bfd9cc0 - data ffff8f491ec6d510/ffff8f49079c7800 00000020:01000000:3.0:1787853166.624526:0:12926:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8f4905651a20 - data ffff8f492c3d2bd0/ffff8f4904f57400 00000020:00000080:3.0:1787853166.625650:0:12926:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x710df789068e5e81 00000020:00000080:3.0:1787853166.625661:0:12926:0:(genops.c:885:class_export_put()) final put ffff8f4939922800/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1787853166.625680:0:12926:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f492abd6000 from MGS, refs=2 00000020:01000004:3.0:1787853166.625684:0:12926:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f492abd6000 2 00000020:01000004:3.0:1787853166.625688:0:12926:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8f492abd6000 from MGS 00000020:00000080:3.0:1787853166.625716:0:12926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787853166.625724:0:12926:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1787853166.625727:0:12926:0:(genops.c:885:class_export_put()) final put ffff8f4939924800/MGS 00000020:00000080:3.0:1787853166.625730:0:12926:0:(genops.c:844:class_export_destroy()) destroying export ffff8f4939924800/MGS for MGS 00000020:01000000:3.0:1787853166.625741:0:12926:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:00000080:1.0:1787853166.625948:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff8f4939922800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1787853166.625960:0:12926:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1787853166.625971:0:12926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787853166.625978:0:12926:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787853166.625986:0:12926:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8f4934109000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787853166.625993:0:12926:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff8f49065fb3a0) has exports, disconnecting them 00000020:00080000:3.0:1787853166.625999:0:12926:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8f4934109000), last request at 1787852900 00000020:00000080:3.0:1787853166.626004:0:12926:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x710df789068e5f4c 00000020:00080000:3.0:1787853166.626017:0:12926:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8f4934109000): rc 0 00000020:00000080:3.0:1787853166.626022:0:12926:0:(genops.c:885:class_export_put()) final put ffff8f4934109000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1787853166.626308:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff8f4934109000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1787853166.635660:0:12926:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1787853166.635670:0:12926:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787853166.635680:0:12926:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787853166.635722:0:12926:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787853166.635940:0:12926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787853166.635949:0:12926:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1787853166.635956:0:12926:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f492abd6000 1 00000020:00000080:2.0:1787853166.635963:0:12926:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x710df789068e5e73 00000020:00000080:2.0:1787853166.635972:0:12926:0:(genops.c:885:class_export_put()) final put ffff8f4939923000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787853166.636027:0:475:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f493410b800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1787853166.636034:0:475:0:(genops.c:885:class_export_put()) final put ffff8f493410a800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1787853166.636037:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff8f493410a800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1787853166.636054:0:475:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000000:2.0:1787853166.636177:0:12926:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1787853166.636182:0:12926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787853166.636198:0:12926:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787853166.636281:0:12926:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff8f49065f99d0) has no exports 00000020:00000080:1.0:1787853166.636465:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff8f4939923000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787853166.729932:0:12926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787853166.729946:0:12926:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1787853166.729952:0:12926:0:(genops.c:885:class_export_put()) final put ffff8f492abd1000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787853166.729956:0:12926:0:(genops.c:844:class_export_destroy()) destroying export ffff8f492abd1000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1787853166.729966:0:12926:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1787853166.730179:0:12926:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8f492abd3000 00000020:01000000:2.0:1787853166.730201:0:12926:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1787853166.730205:0:12926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787853166.730210:0:12926:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787853166.730213:0:12926:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff8f49030099d0) has no exports 00000100:00100000:0.0:1787853166.730874:0:5837:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff8f4908efde00:5837] 1 exiting: rc = 0 00000100:00100000:3.0:1787853166.731069:0:5838:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff8f4908efc000:5838] 2 exiting: rc = 0 00000100:00100000:3.0:1787853166.731154:0:8462:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff8f49415c1e00:8462] 3 exiting: rc = 0 00000100:00100000:0.0:1787853166.731368:0:5836:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff8f4908e55a00:5836] 0 exiting: rc = 1 00000100:00100000:2.0:1787853166.731459:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.731466:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.731473:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.731479:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.731484:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.731490:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.731495:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.735727:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.735748:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.735753:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.735760:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.735765:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.735771:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.735776:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.735782:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.735787:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.735792:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.735797:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.735803:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.735808:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.735813:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.735818:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.735844:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.735850:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.735856:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.735861:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.735867:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.735873:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.735878:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.735885:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.735891:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.735898:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.735903:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.735909:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.735926:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.735932:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.735938:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.735943:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.735949:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.735954:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.735960:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.735968:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.735980:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.735987:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.735992:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.735998:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.736010:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.736016:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.736021:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.736033:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.736039:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.736057:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.736063:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.736069:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.736074:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.736090:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.736096:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.736108:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.736114:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.736120:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.736127:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.736132:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.736137:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.736142:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.742994:0:5839:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff8f4908efd200:5839] 0 exiting: rc = 1 00000100:00100000:0.0:1787853166.743305:0:5840:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff8f4908b2de00:5840] 1 exiting: rc = 0 00000100:00100000:2.0:1787853166.743425:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.743434:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.743442:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.743447:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.743452:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.743459:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.743466:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.743471:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.744192:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.744204:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.744209:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.744216:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.744224:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.744229:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.744235:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.744240:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.744245:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.744250:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.744255:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.744260:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.744265:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.744270:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.744275:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.744280:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.744284:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.744288:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.744293:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.744299:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.744321:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.744326:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.744332:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.744337:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.744341:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.744347:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.744353:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.744360:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.744364:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.744369:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.744374:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.744379:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.744383:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.744388:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.744393:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.744398:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.744402:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.744407:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.744411:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.744416:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.744421:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.744425:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.744430:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.744435:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.744439:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.744444:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.744449:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.744454:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.744458:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.744463:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.744467:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.744473:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.745314:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.745328:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.745333:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.745347:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.747159:0:5841:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff8f4908b2c600:5841] 0 exiting: rc = 1 00000100:00100000:0.0:1787853166.748203:0:5842:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff8f4908b2d200:5842] 1 exiting: rc = 0 00000100:00100000:3.0:1787853166.748427:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.748436:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.748442:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.748448:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.748454:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.748461:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.748466:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.748493:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.748518:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.748524:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.748531:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.748537:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.748543:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.748549:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.748555:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.748561:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.748594:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.748601:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.748607:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.748629:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.748635:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.748641:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.749417:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.749427:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.749433:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.749439:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.749444:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.749451:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.749456:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.749462:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.749469:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.749500:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.749508:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.749515:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.749521:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.749527:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.749534:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.749539:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.749545:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.749551:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.749557:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.749605:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.749613:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.749643:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.749662:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.749668:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.749675:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.749681:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.749687:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.749693:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.749699:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.749705:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.749711:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.749717:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.749722:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.749743:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.749751:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.749757:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.749763:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.749770:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.749881:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.749889:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.749895:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.749913:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853166.780039:0:5844:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff8f4908b2d000:5844] 1 exiting: rc = 0 00000100:00100000:2.0:1787853166.783087:0:5843:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff8f4908b2d800:5843] 0 exiting: rc = 1 00000100:00100000:1.0:1787853166.783342:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853166.783350:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853166.783354:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853166.783360:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853166.783365:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853166.783370:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853166.783374:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853166.783379:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853166.783384:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853166.783389:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853166.783395:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853166.783400:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853166.783405:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853166.783410:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853166.783416:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853166.783421:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853166.783444:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853166.783449:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853166.783455:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853166.783460:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853166.783465:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853166.783470:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853166.783475:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853166.783495:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853166.783500:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853166.783505:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853166.783509:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853166.783514:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853166.783519:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853166.783524:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853166.783528:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853166.783533:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853166.783538:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853166.783543:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853166.783549:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853166.783554:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853166.783559:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853166.783563:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853166.783596:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853166.783602:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853166.783607:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853166.783612:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853166.783617:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853166.783621:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853166.783626:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853166.783631:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853166.783637:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853166.783642:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853166.783662:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853166.783667:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853166.783672:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853166.783684:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853166.783689:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853166.783694:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853166.783699:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853166.783703:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853166.783708:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853166.783714:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853166.783719:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853166.783724:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853166.783729:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853166.783735:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853166.783740:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853166.783745:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.784515:0:5845:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff8f4908b2c400:5845] 0 exiting: rc = 1 00000100:00100000:2.0:1787853166.786049:0:5846:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff8f4908b2c200:5846] 1 exiting: rc = 0 00000100:00100000:3.0:1787853166.786265:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.786272:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.786277:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.786283:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.786287:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.786292:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.786298:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.786303:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.786309:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.786314:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.786319:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.786324:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.786329:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.786355:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.786361:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.786366:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.786371:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.786376:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.786381:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.786387:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.786392:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.786397:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.786401:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.786406:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.786411:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.786417:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.786421:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.786426:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.786430:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.786436:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.786441:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.786446:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.786450:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.786455:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.786460:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.786465:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.786470:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.786476:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.786480:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.786486:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.786491:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.786497:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.786502:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.786507:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.786513:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.786519:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.786524:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.786529:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.786543:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.786548:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.786554:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.786558:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.786563:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.786600:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.786607:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.786612:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.786618:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.786623:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.786629:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.786635:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.786640:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.786655:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.786661:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.786667:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853166.787429:0:5847:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff8f4908b2ca00:5847] 0 exiting: rc = 1 00000100:00100000:2.0:1787853166.788373:0:5848:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff8f4910177200:5848] 1 exiting: rc = 0 00000100:00100000:2.0:1787853166.788795:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.788803:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.788810:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.788816:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.788822:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.788827:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.788833:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.788838:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.788843:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.788849:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.788854:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.788860:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.788865:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.788870:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.788875:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.788881:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.788886:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.788892:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.788897:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.788903:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.788908:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.788914:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.788919:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.788924:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.788930:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.788935:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.788940:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.788945:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.788950:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.788955:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.788960:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.788978:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.788983:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.788988:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.788994:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.788998:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.789004:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.789009:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.789014:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.789019:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.789024:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.789029:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.789034:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.789048:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.789054:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.789059:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.789065:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.789070:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.789075:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.789080:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.789086:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.789091:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.789107:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.789113:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.789118:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.789123:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.789128:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.789133:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.789137:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.789143:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.789147:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.789152:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.789156:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.789162:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.789787:0:5850:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff8f4910177600:5850] 1 exiting: rc = 0 00000100:00100000:2.0:1787853166.790037:0:5851:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff8f4910176400:5851] 2 exiting: rc = 0 00000100:00100000:1.0:1787853166.790915:0:5849:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff8f4910177800:5849] 0 exiting: rc = 1 00000100:00100000:2.0:1787853166.791710:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.791718:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.791724:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.791730:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.791737:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.791743:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.791749:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.791755:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.791760:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.791766:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.791784:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.791794:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.791816:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.791824:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.791831:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.791837:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.791843:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.791850:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.791856:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.791862:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.791868:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.791874:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.791880:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.791886:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.791892:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.791898:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.791904:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.791909:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.791916:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.791922:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.791928:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.791933:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.791938:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.791944:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.791949:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.791967:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.791985:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.791992:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.791997:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.792003:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.792008:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.792013:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.792018:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.792024:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.792029:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.792033:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.792038:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.792054:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.792059:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.792064:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.792069:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.792074:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.792079:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.792084:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.792089:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.792104:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.792110:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.792116:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.792122:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.792128:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.792148:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.792154:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.792161:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853166.792168:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1787853166.810165:0:12926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787853166.810181:0:12926:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1787853166.810188:0:12926:0:(genops.c:885:class_export_put()) final put ffff8f4903131800/MDS_uuid 00000020:00000080:2.0:1787853166.810194:0:12926:0:(genops.c:844:class_export_destroy()) destroying export ffff8f4903131800/MDS_uuid for MDS 00000020:01000000:2.0:1787853166.810200:0:12926:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1787853166.815684:0:12926:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00000001:00100000:2.0:1787853166.915901:0:6712:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787853166.915908:0:6712:0:(genops.c:885:class_export_put()) final put ffff8f48011b6800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787853166.917911:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff8f48011b6800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1787853166.918054:0:475:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f48011b4000 for lustre-OST0000 00000100:00100000:1.0:1787853167.344017:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4803e67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1874699552386176:0@lo:400:kworker.0 00000400:00000100:1.0:1787853167.344095:0:3308:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874699552386176 offset 0 length 224: 4 00000100:00100000:1.0:1787853167.344154:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787853167.344161:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4803e66d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1874699552386304:0@lo:400:kworker.0 00000400:00000100:1.0:1787853167.344179:0:3308:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874699552386304 offset 0 length 224: 4 00000100:00100000:3.0:1787853167.344667:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787853167.344680:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4803e66580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5d48a955-7010-4118-9c7d-f396984ae1ff:3306:1874699552386048:0@lo:400:kworker.0 00000400:00000100:3.0:1787853167.344710:0:3306:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874699552386048 offset 0 length 224: 4 00010000:00010000:1.0:1787853167.407067:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853168.426381:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787853169.449788:0:7641:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787853169.449798:0:7641:0:(genops.c:885:class_export_put()) final put ffff8f4941583800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787853169.449824:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8f4941583800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1787853169.449876:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f4941585800 for lustre-OST0001 00010000:00010000:1.0:1787853169.450705:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787853170.186197:0:13084:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1787853170.206789:0:13084:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1787853170.206847:0:13084:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f492a8acc00/0x710df789068e61a6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e61ad expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853170.206864:0:13084:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f492a8acc00/0x710df789068e61a6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x710df789068e61ad expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853170.206872:0:13084:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f492a8acc00/0x710df789068e61a6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x710df789068e61ad expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853170.206900:0:13084:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.101@tcp lock: ffff8f492a8acc00/0x710df789068e61a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x710df789068e61ad expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853170.206918:0:13084:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787853170.206924:0:13084:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1787853170.206953:0:13084:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787853170.206967:0:13084:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f4803e67480 x1874699552386176/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787853183 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787853170.206999:0:13084:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1787853170.207006:0:13084:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787853170.207033:0:13084:0:(import.c:65:import_set_state_nolock()) ffff8f480186c000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1787853170.207205:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4803e67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1874699552386176:0@lo:400:kworker.0 00010000:00010000:2.0:1787853170.207629:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787853170.207640:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.101@tcp lock: ffff8f492a8acc00/0x710df789068e61a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x710df789068e61ad expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853170.207648:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f492a8acc00 already unused, calling callback (ffffffffc1b55c20) 10000000:00010000:2.0:1787853170.207652:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.101@tcp lock: ffff8f492a8acc00/0x710df789068e61a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x710df789068e61ad expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853170.207662:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.101@tcp lock: ffff8f492a8acc00/0x710df789068e61a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x710df789068e61ad expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787853170.207669:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.101@tcp lock: ffff8f492a8acc00/0x710df789068e61a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x710df789068e61ad expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787853170.207675:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787853170.207677:0:5826:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1787853170.207680:0:5826:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00000100:00100000:3.0:1787853170.207959:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4803e661c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1874699552386432:0@lo:39:umount.0 00000400:00000100:3.0:1787853170.208019:0:3305:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874699552386432 offset 0 length 224: 4 00010000:00010000:2.0:1787853170.208123:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.101@tcp lock: ffff8f492a8acc00/0x710df789068e61a6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x710df789068e61ad expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853170.208131:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787853170.208160:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.101@tcp lock: ffff8f492a8acc00/0x710df789068e61a6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x710df789068e61ad expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853170.208177:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.101@tcp lock: ffff8f492a8acc00/0x710df789068e61a6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x710df789068e61ad expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853170.208189:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853170.208191:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853170.208205:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787853170.208409:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f492eb89a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5d48a955-7010-4118-9c7d-f396984ae1ff:3306:1874699552386560:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787853170.208449:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853170.209038:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552386560 00000100:00100000:2.0:1787853170.209047:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552386560 00000100:00100000:2.0:1787853170.209100:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787853170.209108:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4934117c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3306:x1874699552386560:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1787853170.209115:0:5822:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787853170 with bad export cookie 8146439468875669149 00000100:00100000:2.0:1787853170.216302:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4934117c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3306:x1874699552386560:12345-0@lo:103:ldlm_bl.0 Request processed in 7184us (7844us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787853170.216317:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1787853170.216857:0:3306:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.101@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787853170.216863:0:3306:0:(import.c:65:import_set_state_nolock()) ffff8f4939921000 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1787853170.216868:0:3306:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.101@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:1.0:1787853170.223292:0:3306:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.101@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1787853170.223298:0:3306:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1787853170.223308:0:3306:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f4803e66580 x1874699552386048/t0(0) o400->MGC192.168.204.101@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787853183 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787853170.223324:0:3306:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f492eb89a40 x1874699552386560/t0(0) o103->MGC192.168.204.101@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787853186 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1787853170.223333:0:3306:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1787853170.223336:0:3306:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1787853170.223337:0:3306:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1787853170.223341:0:3306:0:(import.c:65:import_set_state_nolock()) ffff8f4939921000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787853170.223346:0:3306:0:(import.c:510:import_select_connection()) MGC192.168.204.101@tcp: connect to NID 0@lo last attempt 218 00000100:00080000:1.0:1787853170.223355:0:3306:0:(import.c:624:import_select_connection()) MGC192.168.204.101@tcp: import ffff8f4939921000 using connection 192.168.204.101@tcp/0@lo 00000100:00100000:1.0:1787853170.223428:0:3306:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f4803e64000 x1874699552386688/t0(0) o250->MGC192.168.204.101@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787853170.223498:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4803e66580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5d48a955-7010-4118-9c7d-f396984ae1ff:3306:1874699552386048:0@lo:400:kworker.0 00000100:00100000:1.0:1787853170.223534:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f492eb89a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5d48a955-7010-4118-9c7d-f396984ae1ff:3306:1874699552386560:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787853170.223905:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4803e64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5d48a955-7010-4118-9c7d-f396984ae1ff:3305:1874699552386688:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:3.0:1787853170.223959:0:3305:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874699552386688 offset 0 length 520: 4 00010000:00010000:0.0:1787853170.474987:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853171.501975:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787853172.457799:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5d48a955-7010-4118-9c7d-f396984ae1ff->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787853172.457809:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 5d48a955-7010-4118-9c7d-f396984ae1ff->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787853172.458030:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49092bcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1874699552386816:0@lo:400:kworker.0 00000400:00000100:1.0:1787853172.458087:0:3307:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874699552386816 offset 0 length 224: 4 00010000:00010000:2.0:1787853172.521869:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853173.545934:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853174.570976:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787853175.465919:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5d48a955-7010-4118-9c7d-f396984ae1ff->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787853175.465930:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 5d48a955-7010-4118-9c7d-f396984ae1ff->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787853175.466042:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787853175.466064:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f492eb8a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1874699552386944:0@lo:400:kworker.0 00000400:00000100:1.0:1787853175.466117:0:3309:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874699552386944 offset 0 length 224: 4 00010000:00010000:2.0:1787853175.594343:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853176.622212:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853177.644292:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853178.667412:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853179.690883:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787853180.651225:0:475:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5d48a955-7010-4118-9c7d-f396984ae1ff->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787853180.651237:0:475:0:(pinger.c:247:ptlrpc_pinger_process_import()) 5d48a955-7010-4118-9c7d-f396984ae1ff->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787853180.651351:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f492eb8b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1874699552387072:0@lo:400:kworker.0 00000400:00000100:1.0:1787853180.651421:0:3309:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874699552387072 offset 0 length 224: 4 00000100:00100000:2.0:1787853180.655824:0:3305:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787853170/real 1787853170] req@ffff8f4803e64000 x1874699552386688/t0(0) o250->MGC192.168.204.101@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787853180 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787853180.655858:0:3305:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8f4803e64000 x1874699552386688/t0(0) o250->MGC192.168.204.101@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787853180 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787853180.655870:0:3305:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787853170/real 1787853170] req@ffff8f4803e661c0 x1874699552386432/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787853180 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787853180.655881:0:3305:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8f4803e661c0 x1874699552386432/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787853180 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787853180.655897:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8f4939921000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787853180.655940:0:3305:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1787853180.655945:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4803e64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5d48a955-7010-4118-9c7d-f396984ae1ff:3305:1874699552386688:0@lo:250:ptlrpcd_00_00.0 00000100:00080000:2.0:1787853180.655951:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8f480186c000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1787853180.656128:0:475:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5d48a955-7010-4118-9c7d-f396984ae1ff->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787853180.656133:0:475:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1787853180.656136:0:475:0:(import.c:65:import_set_state_nolock()) ffff8f4939921000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787853180.656141:0:475:0:(import.c:510:import_select_connection()) MGC192.168.204.101@tcp: connect to NID 0@lo last attempt 489 00000100:00080000:0.0:1787853180.656146:0:475:0:(import.c:589:import_select_connection()) MGC192.168.204.101@tcp: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787853180.656153:0:475:0:(import.c:624:import_select_connection()) MGC192.168.204.101@tcp: import ffff8f4939921000 using connection 192.168.204.101@tcp/0@lo 00000100:00100000:0.0:1787853180.656187:0:475:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f49092bde00 x1874699552387200/t0(0) o250->MGC192.168.204.101@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787853180.658620:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4803e661c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1874699552386432:0@lo:39:umount.0 00000100:00100000:2.0:1787853180.658679:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49092bde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5d48a955-7010-4118-9c7d-f396984ae1ff:3305:1874699552387200:0@lo:250:kworker.0 00000400:00000100:2.0:1787853180.658749:0:3305:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874699552387200 offset 0 length 520: 4 00000100:00080000:0.0:1787853180.661961:0:13084:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787853180.661972:0:13084:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787853180.661979:0:13084:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1787853180.663034:0:13084:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f4921e20800/0x710df789068e61b4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e61bb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853180.663051:0:13084:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f4921e20800/0x710df789068e61b4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x710df789068e61bb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853180.663059:0:13084:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f4921e20800/0x710df789068e61b4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x710df789068e61bb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853180.663066:0:13084:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.101@tcp lock: ffff8f4921e20800/0x710df789068e61b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x710df789068e61bb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853180.663099:0:13084:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787853180.663107:0:13084:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f492a8ace00/0x710df789068e63dd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e63e4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853180.663114:0:13084:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f492a8ace00/0x710df789068e63dd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x710df789068e63e4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853180.663120:0:13084:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f492a8ace00/0x710df789068e63dd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x710df789068e63e4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853180.663125:0:13084:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.101@tcp lock: ffff8f492a8ace00/0x710df789068e63dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x710df789068e63e4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853180.663143:0:13084:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1787853180.663148:0:13084:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1787853180.663171:0:13084:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1787853180.663175:0:13084:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1787853180.663181:0:13084:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787853180.663186:0:13084:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787853180.663202:0:13084:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff8f49065fcd70) has no exports 00000020:00080000:0.0:1787853180.663226:0:13084:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff8f49065fcd70) has no exports 00010000:00010000:1.0:1787853180.665387:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787853180.665400:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.101@tcp lock: ffff8f4921e20800/0x710df789068e61b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x710df789068e61bb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853180.665412:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4921e20800 already unused, calling callback (ffffffffc1b55c20) 10000000:00010000:1.0:1787853180.665417:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.101@tcp lock: ffff8f4921e20800/0x710df789068e61b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x710df789068e61bb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853180.665428:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.101@tcp lock: ffff8f4921e20800/0x710df789068e61b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x710df789068e61bb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787853180.665436:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.101@tcp lock: ffff8f4921e20800/0x710df789068e61b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x710df789068e61bb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787853180.665466:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787853180.665469:0:5825:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:1.0:1787853180.665474:0:5825:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:1.0:1787853180.665496:0:5825:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8f4939921000 00010000:00010000:1.0:1787853180.665500:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.101@tcp lock: ffff8f4921e20800/0x710df789068e61b4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x710df789068e61bb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853180.665506:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.101@tcp lock: ffff8f4921e20800/0x710df789068e61b4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x710df789068e61bb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853180.665525:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787853180.665529:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.101@tcp lock: ffff8f492a8ace00/0x710df789068e63dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x710df789068e63e4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853180.665535:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f492a8ace00 already unused, calling callback (ffffffffc1b55c20) 10000000:00010000:1.0:1787853180.665537:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.101@tcp lock: ffff8f492a8ace00/0x710df789068e63dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x710df789068e63e4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853180.665544:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.101@tcp lock: ffff8f492a8ace00/0x710df789068e63dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x710df789068e63e4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787853180.665551:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.101@tcp lock: ffff8f492a8ace00/0x710df789068e63dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x710df789068e63e4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787853180.665555:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1787853180.665558:0:5825:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1787853180.665559:0:5825:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1787853180.665565:0:5825:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8f4939921000 00010000:00010000:1.0:1787853180.665613:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.101@tcp lock: ffff8f492a8ace00/0x710df789068e63dd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x710df789068e63e4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853180.665625:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.101@tcp lock: ffff8f492a8ace00/0x710df789068e63dd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x710df789068e63e4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853180.665634:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853180.665636:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853180.665638:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853180.665821:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1787853180.669912:0:13084:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8f4934820b40 - data ffff8f4937d2b6c0/ffff8f493feca400 00000020:01000000:0.0:1787853180.670531:0:13084:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8f49092e77e0 - data ffff8f491ef4eca8/ffff8f493ff32400 00100000:10000000:0.0:1787853180.685894:0:13084:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00010000:00010000:0.0:1787853180.714758:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787853180.735958:0:13084:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x710df789068e6002 00000020:00000080:2.0:1787853180.735968:0:13084:0:(genops.c:885:class_export_put()) final put ffff8f493ff07800/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1787853180.735992:0:13084:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f4903010800 from lustre-OST0000, refs=2 00000020:01000004:2.0:1787853180.735996:0:13084:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f4903010800 2 00000020:01000004:2.0:1787853180.736006:0:13084:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8f4903010800 from lustre-OST0000 00000020:00000080:2.0:1787853180.736031:0:13084:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787853180.736040:0:13084:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1787853180.736043:0:13084:0:(genops.c:885:class_export_put()) final put ffff8f493ff04800/lustre-OST0000_UUID 00000020:00000080:2.0:1787853180.736046:0:13084:0:(genops.c:844:class_export_destroy()) destroying export ffff8f493ff04800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1787853180.736052:0:13084:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1787853180.736108:0:13084:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1787853180.736113:0:13084:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1787853180.736116:0:13084:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787853180.736121:0:13084:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787853180.736128:0:13084:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8f48011b1000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787853180.736133:0:13084:0:(genops.c:1553:class_disconnect_exports()) OBD device 13 (ffff8f493484b3a0) has exports, disconnecting them 00000020:00080000:2.0:1787853180.736138:0:13084:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8f48011b1000), last request at 1787852921 00000020:00000080:2.0:1787853180.736142:0:13084:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x710df789068e602c 00000020:00080000:2.0:1787853180.736151:0:13084:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8f48011b1000): rc 0 00000020:00000080:2.0:1787853180.736156:0:13084:0:(genops.c:885:class_export_put()) final put ffff8f48011b1000/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1787853180.737086:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff8f493ff07800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1787853180.737100:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff8f48011b1000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:3.0:1787853180.738646:0:13084:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:3.0:1787853180.738653:0:13084:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787853180.738667:0:13084:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1787853180.738674:0:13084:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787853180.738846:0:13084:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787853180.738855:0:13084:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:3.0:1787853180.738861:0:13084:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f4903010800 1 00000020:00000080:3.0:1787853180.738867:0:13084:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x710df789068e5f7d 00000020:00000080:3.0:1787853180.738875:0:13084:0:(genops.c:885:class_export_put()) final put ffff8f494129d800/lustre-OST0000-osd_UUID 00000020:01000000:3.0:1787853180.738880:0:13084:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:3.0:1787853180.738899:0:13084:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787853180.738904:0:13084:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787853180.738907:0:13084:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff8f49065f8000) has no exports 00000020:00000080:0.0:1787853180.739897:0:475:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f480186c000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1787853180.739908:0:475:0:(genops.c:885:class_export_put()) final put ffff8f4801869800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1787853180.739911:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff8f4801869800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1787853180.739921:0:475:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:0.0:1787853180.740394:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff8f494129d800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1787853180.762339:0:13084:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787853180.762357:0:13084:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1787853180.762363:0:13084:0:(genops.c:885:class_export_put()) final put ffff8f4903015000/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1787853180.762368:0:13084:0:(genops.c:844:class_export_destroy()) destroying export ffff8f4903015000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1787853180.762440:0:13084:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1787853180.762716:0:13084:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8f4903015800 00000020:02000400:0.0:1787853180.762821:0:13084:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1787853181.738078:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853182.761884:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:1.0:1787853183.530391:0:3308:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787853167/real 1787853167] req@ffff8f4803e66d00 x1874699552386304/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787853183 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787853183.572412:0:3308:0:(client.c:2547:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff8f4803e66d00 x1874699552386304/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787853183 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787853183.572429:0:3308:0:(import.c:65:import_set_state_nolock()) ffff8f49415c8000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1787853183.572434:0:3308:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1787853183.597670:0:3308:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0000_UUID: waking up pinger s:DISCONN 00000100:00080000:0.0:1787853183.597826:0:475:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5d48a955-7010-4118-9c7d-f396984ae1ff->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787853183.597832:0:475:0:(pinger.c:247:ptlrpc_pinger_process_import()) 5d48a955-7010-4118-9c7d-f396984ae1ff->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787853183.597834:0:475:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787853183.597837:0:475:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787853183.597841:0:475:0:(import.c:65:import_set_state_nolock()) ffff8f49415c8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787853183.597848:0:475:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 265 00000100:00080000:0.0:1787853183.597857:0:475:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8f49415c8000 using connection 192.168.204.101@tcp/0@lo 00000100:00100000:0.0:1787853183.597907:0:475:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f49092bed00 x1874699552387328/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787853183.597950:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49092bed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1874699552387328:0@lo:38:kworker.0 00000100:00100000:0.0:1787853183.597951:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4803e66d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1874699552386304:0@lo:400:kworker.0 00000400:00000100:2.0:1787853183.598003:0:3305:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874699552387328 offset 0 length 520: 4 00010000:00010000:0.0:1787853183.785833:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787853183.996793:0:13236:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1787853184.010992:0:13236:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1787853184.011064:0:13236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f4900031e00/0x710df789068e618a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e6191 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853184.011078:0:13236:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f4900031e00/0x710df789068e618a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x710df789068e6191 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853184.011086:0:13236:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f4900031e00/0x710df789068e618a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x710df789068e6191 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853184.011093:0:13236:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.101@tcp lock: ffff8f4900031e00/0x710df789068e618a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x710df789068e6191 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853184.011127:0:13236:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787853184.011133:0:13236:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1787853184.011151:0:13236:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787853184.011163:0:13236:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f49092bcb40 x1874699552386816/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787853188 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787853184.011186:0:13236:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f492eb8a1c0 x1874699552386944/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787853191 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787853184.011201:0:13236:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f492eb8b0c0 x1874699552387072/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787853196 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787853184.011209:0:13236:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f49092bed00 x1874699552387328/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787853193 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787853184.011218:0:13236:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00100000:1.0:1787853184.011248:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f492eb8b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1874699552387072:0@lo:400:kworker.0 00000100:00100000:1.0:1787853184.011254:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f492eb8a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1874699552386944:0@lo:400:kworker.0 00000100:00080000:1.0:1787853184.011284:0:13236:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787853184.011289:0:13236:0:(import.c:65:import_set_state_nolock()) ffff8f49415c8000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1787853184.011294:0:13236:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787853184.011297:0:13236:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f49092bcb40 x1874699552386816/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787853188 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787853184.011304:0:13236:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f49092bed00 x1874699552387328/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787853193 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787853184.011320:0:13236:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787853184.011323:0:13236:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 12s for inflight to error out 00010000:00010000:2.0:1787853184.011438:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787853184.011445:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.101@tcp lock: ffff8f4900031e00/0x710df789068e618a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x710df789068e6191 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853184.011453:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4900031e00 already unused, calling callback (ffffffffc1b55c20) 10000000:00010000:2.0:1787853184.011456:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.101@tcp lock: ffff8f4900031e00/0x710df789068e618a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x710df789068e6191 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853184.011464:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.101@tcp lock: ffff8f4900031e00/0x710df789068e618a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x710df789068e6191 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787853184.011472:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.101@tcp lock: ffff8f4900031e00/0x710df789068e618a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x710df789068e6191 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787853184.011477:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787853184.011479:0:5825:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1787853184.011481:0:5825:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1787853184.011495:0:5825:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8f4939921000 00010000:00010000:2.0:1787853184.011499:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.101@tcp lock: ffff8f4900031e00/0x710df789068e618a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x710df789068e6191 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853184.011505:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.101@tcp lock: ffff8f4900031e00/0x710df789068e618a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x710df789068e6191 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853184.011515:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853184.011517:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853184.011518:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787853184.011536:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49092bed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1874699552387328:0@lo:38:kworker.0 00000100:00100000:3.0:1787853184.011644:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49092bcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1874699552386816:0@lo:400:kworker.0 00010000:00010000:1.0:1787853184.012900:0:13236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f4900030e00/0x710df789068e6198 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e619f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853184.012924:0:13236:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f4900030e00/0x710df789068e6198 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x710df789068e619f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853184.012932:0:13236:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f4900030e00/0x710df789068e6198 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x710df789068e619f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853184.012938:0:13236:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.101@tcp lock: ffff8f4900030e00/0x710df789068e6198 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x710df789068e619f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853184.012998:0:13236:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787853184.013006:0:13236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f4921e21600/0x710df789068e63cf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e63d6 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853184.013013:0:13236:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f4921e21600/0x710df789068e63cf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x710df789068e63d6 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853184.013018:0:13236:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f4921e21600/0x710df789068e63cf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x710df789068e63d6 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853184.013023:0:13236:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.101@tcp lock: ffff8f4921e21600/0x710df789068e63cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x710df789068e63d6 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853184.013136:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787853184.013143:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.101@tcp lock: ffff8f4900030e00/0x710df789068e6198 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x710df789068e619f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853184.013150:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4900030e00 already unused, calling callback (ffffffffc1b55c20) 10000000:00010000:2.0:1787853184.013154:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.101@tcp lock: ffff8f4900030e00/0x710df789068e6198 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x710df789068e619f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853184.013161:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.101@tcp lock: ffff8f4900030e00/0x710df789068e6198 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x710df789068e619f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787853184.013168:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.101@tcp lock: ffff8f4900030e00/0x710df789068e6198 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x710df789068e619f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787853184.013173:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787853184.013176:0:5826:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:2.0:1787853184.013185:0:5826:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8f4939921000 00010000:00010000:2.0:1787853184.013189:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.101@tcp lock: ffff8f4900030e00/0x710df789068e6198 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x710df789068e619f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853184.013196:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.101@tcp lock: ffff8f4900030e00/0x710df789068e6198 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x710df789068e619f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853184.013209:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787853184.013212:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.101@tcp lock: ffff8f4921e21600/0x710df789068e63cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x710df789068e63d6 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853184.013218:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4921e21600 already unused, calling callback (ffffffffc1b55c20) 10000000:00010000:2.0:1787853184.013220:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.101@tcp lock: ffff8f4921e21600/0x710df789068e63cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x710df789068e63d6 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853184.013239:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.101@tcp lock: ffff8f4921e21600/0x710df789068e63cf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x710df789068e63d6 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787853184.013246:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.101@tcp lock: ffff8f4921e21600/0x710df789068e63cf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x710df789068e63d6 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787853184.013250:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1787853184.013252:0:5826:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:2.0:1787853184.013257:0:5826:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8f4939921000 00010000:00010000:2.0:1787853184.013260:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.101@tcp lock: ffff8f4921e21600/0x710df789068e63cf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x710df789068e63d6 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853184.013267:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853184.013268:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853184.013270:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853184.013395:0:13236:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787853184.013400:0:13236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.101@tcp lock: ffff8f4921e21600/0x710df789068e63cf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x710df789068e63d6 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787853184.013415:0:13236:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:1.0:1787853184.013420:0:13236:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:1.0:1787853184.013422:0:13236:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:1.0:1787853184.013448:0:13236:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1787853184.013451:0:13236:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:1.0:1787853184.013456:0:13236:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787853184.013462:0:13236:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787853184.013465:0:13236:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8f493ffe19d0) has no exports 00000020:00080000:1.0:1787853184.013489:0:13236:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8f493ffe19d0) has no exports 00010000:00010000:0.0:1787853184.013667:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1787853184.019028:0:13236:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8f4934820540 - data ffff8f491ef8be58/ffff8f4941722c00 00000020:01000000:1.0:1787853184.019200:0:13236:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8f4908534000 - data ffff8f4937d69ca8/ffff8f493fdae000 00100000:10000000:1.0:1787853184.032910:0:13236:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1787853184.049479:0:13236:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x710df789068e608e 00000020:00000080:2.0:1787853184.049490:0:13236:0:(genops.c:885:class_export_put()) final put ffff8f493dc07000/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1787853184.049511:0:13236:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f493dc01800 from lustre-OST0001, refs=2 00000020:01000004:2.0:1787853184.049515:0:13236:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f493dc01800 2 00000020:01000004:2.0:1787853184.049517:0:13236:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8f493dc01800 from lustre-OST0001 00000020:00000080:2.0:1787853184.049541:0:13236:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787853184.049550:0:13236:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1787853184.049552:0:13236:0:(genops.c:885:class_export_put()) final put ffff8f493ff03800/lustre-OST0001_UUID 00000020:00000080:2.0:1787853184.049555:0:13236:0:(genops.c:844:class_export_destroy()) destroying export ffff8f493ff03800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1787853184.049561:0:13236:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000020:00000080:0.0:1787853184.049730:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff8f493dc07000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00080000:3.0:1787853184.050044:0:13236:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 5d48a955-7010-4118-9c7d-f396984ae1ff->MGS 00010000:00010000:3.0:1787853184.050062:0:13236:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.101@tcp lock: ffff8f49013fde00/0x710df789068e5fdf lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x710df789068e5fe6 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787853184.050075:0:13236:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.101@tcp lock: ffff8f49013fde00/0x710df789068e5fdf lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x710df789068e5fe6 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787853184.050082:0:13236:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1787853184.050084:0:13236:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1787853184.050088:0:13236:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1787853184.050103:0:13236:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8f4939921000 00010000:00010000:3.0:1787853184.050107:0:13236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.101@tcp lock: ffff8f49013fde00/0x710df789068e5fdf lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x710df789068e5fe6 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853184.050123:0:13236:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.101@tcp lock: ffff8f492a8ad400/0x710df789068e61de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x710df789068e61e5 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787853184.050130:0:13236:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.101@tcp lock: ffff8f492a8ad400/0x710df789068e61de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x710df789068e61e5 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787853184.050151:0:13236:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787853184.050153:0:13236:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1787853184.050155:0:13236:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1787853184.050164:0:13236:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8f4939921000 00010000:00010000:3.0:1787853184.050167:0:13236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.101@tcp lock: ffff8f492a8ad400/0x710df789068e61de lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x710df789068e61e5 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787853184.050184:0:13236:0:(import.c:65:import_set_state_nolock()) ffff8f4939921000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1787853184.050188:0:13236:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1787853184.050191:0:13236:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1787853184.050192:0:13236:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1787853184.050196:0:13236:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1787853184.050208:0:13236:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f49092bde00 x1874699552387200/t0(0) o250->MGC192.168.204.101@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1787853195 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1787853184.050230:0:13236:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1787853184.050234:0:13236:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 14s for inflight to error out 00000100:00100000:2.0:1787853184.050381:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49092bde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5d48a955-7010-4118-9c7d-f396984ae1ff:3305:1874699552387200:0@lo:250:kworker.0 10000000:01000000:3.0:1787853184.050440:0:13236:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1787853184.050447:0:13236:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x710df789068e5e8f 00000020:00000080:3.0:1787853184.050453:0:13236:0:(genops.c:885:class_export_put()) final put ffff8f4939925000/5d48a955-7010-4118-9c7d-f396984ae1ff 00000020:01000000:3.0:1787853184.050471:0:13236:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.204.101@tcp (flags='') 00000020:00000080:3.0:1787853184.050477:0:13236:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787853184.050482:0:13236:0:(obd_config.c:956:class_cleanup()) MGC192.168.204.101@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787853184.050485:0:13236:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff8f490300cd70) has no exports 10000000:01000000:3.0:1787853184.050501:0:5834:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:3.0:1787853184.050549:0:13236:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.204.101@tcp: client import never connected 00000100:00080000:3.0:1787853184.050551:0:13236:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1787853184.050553:0:13236:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1787853184.050555:0:13236:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1787853184.050556:0:13236:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1787853184.050619:0:13236:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787853184.050624:0:13236:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.204.101@tcp (uuid 5d48a955-7010-4118-9c7d-f396984ae1ff) 00000020:01000000:3.0:1787853184.050634:0:13236:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1787853184.050637:0:13236:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787853184.050641:0:13236:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787853184.050646:0:13236:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff8f49415cb800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787853184.050651:0:13236:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff8f49415e0000) has exports, disconnecting them 00000020:00080000:3.0:1787853184.050654:0:13236:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff8f49415cb800), last request at 1787852945 00000020:00000080:3.0:1787853184.050658:0:13236:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x710df789068e60b8 00000020:00080000:3.0:1787853184.050669:0:13236:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8f49415cb800): rc 0 00000020:00000080:3.0:1787853184.050672:0:13236:0:(genops.c:885:class_export_put()) final put ffff8f49415cb800/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1787853184.051610:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff8f4939925000/5d48a955-7010-4118-9c7d-f396984ae1ff for MGC192.168.204.101@tcp 00000020:00000080:2.0:1787853184.051620:0:475:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f4939921000 for MGC192.168.204.101@tcp 00000020:00000080:2.0:1787853184.051626:0:475:0:(genops.c:885:class_export_put()) final put ffff8f4903136000/5d48a955-7010-4118-9c7d-f396984ae1ff 00000020:00000080:2.0:1787853184.051637:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff8f4903136000/5d48a955-7010-4118-9c7d-f396984ae1ff for MGC192.168.204.101@tcp 00000020:01000000:2.0:1787853184.051642:0:475:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.204.101@tcp (5d48a955-7010-4118-9c7d-f396984ae1ff) 00000020:00000080:2.0:1787853184.051894:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff8f49415cb800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1787853184.052716:0:13236:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1787853184.052721:0:13236:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787853184.052725:0:13236:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787853184.052732:0:13236:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1787853184.052792:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:2.0:1787853184.052890:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:0.0:1787853184.053034:0:8449:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000020:00000080:0.0:1787853184.053101:0:475:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f49415c8000 for lustre-MDT0000-lwp-OST0001 00000100:00100000:2.0:1787853184.053194:0:5820:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff8f4911c25000:5820] 0 exiting: rc = 1 00000100:00100000:0.0:1787853184.053285:0:7630:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff8f492529de00:7630] 2 exiting: rc = 0 00000100:00100000:2.0:1787853184.054732:0:5821:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff8f4911c24c00:5821] 1 exiting: rc = 0 00000100:00100000:2.0:1787853184.054825:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.055070:0:5824:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff8f490655ee00:5824] 2 exiting: rc = 0 00000100:00100000:2.0:1787853184.055132:0:5822:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff8f490655f800:5822] 0 exiting: rc = 1 00000100:00100000:2.0:1787853184.055215:0:8450:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff8f48019bb600:8450] 3 exiting: rc = 0 00000100:00100000:0.0:1787853184.055696:0:5823:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff8f4914c4c600:5823] 1 exiting: rc = 0 00000100:00100000:2.0:1787853184.056790:0:11175:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_004: service thread [ffff8f48019bae00:11175] 4 exiting: rc = 0 00000100:00100000:0.0:1787853184.056969:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.056979:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.056986:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.056992:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.056998:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.057004:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.057010:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.057016:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.057021:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.057028:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.057034:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.057040:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.057046:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.057053:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.057058:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.057064:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.057072:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.057077:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.057082:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.057088:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.057093:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.057110:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.057115:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.057120:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.057126:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.057131:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.057137:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.057143:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.057148:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.057153:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.057159:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.057164:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.057170:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.057176:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.057182:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.057188:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.057193:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.057200:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.057205:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.057211:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.057217:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.057222:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.057227:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.057233:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.057238:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.057243:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.057247:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.057252:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.057257:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.057262:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.057267:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.057272:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.057278:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.057283:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.057288:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.057293:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.057306:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.057322:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.057328:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.057333:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.057338:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.057344:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.057350:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.057356:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1787853184.058352:0:13236:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787853184.058361:0:13236:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:0.0:1787853184.058367:0:13236:0:(genops.c:885:class_export_put()) final put ffff8f49415ca000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:0.0:1787853184.058372:0:13236:0:(genops.c:844:class_export_destroy()) destroying export ffff8f49415ca000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:0.0:1787853184.058378:0:13236:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:0.0:1787853184.058425:0:13236:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f493dc01800 1 00000020:00000080:0.0:1787853184.058432:0:13236:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x710df789068e605d 00000020:00000080:0.0:1787853184.058439:0:13236:0:(genops.c:885:class_export_put()) final put ffff8f4903011000/lustre-OST0001-osd_UUID 00000020:01000000:0.0:1787853184.058665:0:13236:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:0.0:1787853184.058671:0:13236:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787853184.058676:0:13236:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787853184.058680:0:13236:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff8f4941afb3a0) has no exports 00000020:00000080:2.0:1787853184.060193:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff8f4903011000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1787853184.078522:0:13236:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787853184.078537:0:13236:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1787853184.078544:0:13236:0:(genops.c:885:class_export_put()) final put ffff8f493dc02800/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1787853184.078549:0:13236:0:(genops.c:844:class_export_destroy()) destroying export ffff8f493dc02800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1787853184.078558:0:13236:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1787853184.078795:0:13236:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8f493dc02000 00000020:01000000:2.0:1787853184.078819:0:13236:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1787853184.078823:0:13236:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787853184.078828:0:13236:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787853184.078832:0:13236:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff8f4941af99d0) has no exports 00000020:00000080:2.0:1787853184.078859:0:13236:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787853184.078865:0:13236:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1787853184.078867:0:13236:0:(genops.c:885:class_export_put()) final put ffff8f494129a000/OSS_uuid 00000020:00000080:2.0:1787853184.078879:0:13236:0:(genops.c:844:class_export_destroy()) destroying export ffff8f494129a000/OSS_uuid for OSS 00000020:01000000:2.0:1787853184.078883:0:13236:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:2.0:1787853184.078910:0:5833:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1787853184.079074:0:6684:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff8f4911ffc000:6684] 2 exiting: rc = 0 00000100:00100000:2.0:1787853184.079125:0:8463:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff8f49079e7000:8463] 3 exiting: rc = 0 00000100:00100000:2.0:1787853184.079170:0:6682:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff8f4941aefc00:6682] 1 exiting: rc = 0 00000100:00100000:0.0:1787853184.081308:0:12025:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff8f4803e7e800:12025] 4 exiting: rc = 0 00000100:00100000:0.0:1787853184.083508:0:6681:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff8f4941aef400:6681] 0 exiting: rc = 1 00000100:00100000:2.0:1787853184.083682:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.083691:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.083701:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.083718:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.083723:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.083731:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.083736:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.083740:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.083745:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.083749:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.083754:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.083759:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.083763:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.083769:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.083775:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.083780:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.083785:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.083790:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.083795:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.083800:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.083805:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.083810:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.083815:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.083821:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.083825:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.083830:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.083836:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.083842:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.083847:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.083867:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.083873:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.083878:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.083883:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.083888:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.083893:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.083899:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.083904:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.083909:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.083914:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.083919:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.083924:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.083930:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.083935:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.083940:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.083945:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.083950:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.083960:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.083965:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.083970:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.083975:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.083980:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.083986:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.083991:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.083996:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.084001:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.084006:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.084012:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.084017:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.084022:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.084028:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.084033:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.084038:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.084043:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.084048:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.085266:0:6686:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff8f4934171000:6686] 1 exiting: rc = 0 00000100:00100000:0.0:1787853184.085736:0:10348:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff8f493ffdb200:10348] 2 exiting: rc = 0 00000100:00100000:0.0:1787853184.088675:0:6685:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff8f4934171800:6685] 0 exiting: rc = 1 00000100:00100000:2.0:1787853184.088838:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.088848:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.088854:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.088860:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.088865:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.088870:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.088875:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.088879:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.088883:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.088888:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.088893:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.088898:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.088902:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.088907:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.088913:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.088917:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.088922:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.088927:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.088931:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.088936:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.088941:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.088946:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.088951:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.088955:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.088960:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.088964:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.088969:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.088974:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.088978:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.088983:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.088988:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.088993:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.088997:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.089002:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.089006:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.089021:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.089026:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.089031:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.089036:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.089041:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.089046:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.089051:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.089055:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.089060:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.089065:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.089070:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.089075:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.089080:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.089084:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.089090:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.089095:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.089099:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.089104:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.089109:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.089113:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.089118:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.089122:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.089126:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.089131:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.089136:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.089140:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.089145:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.089150:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.089154:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.090208:0:6687:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff8f4941aee800:6687] 0 exiting: rc = 1 00000100:00100000:2.0:1787853184.090424:0:12023:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_003: service thread [ffff8f4803e7f600:12023] 3 exiting: rc = 0 00000100:00100000:0.0:1787853184.090744:0:6688:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff8f4934170a00:6688] 1 exiting: rc = 0 00000100:00100000:3.0:1787853184.091117:0:6689:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff8f4934171a00:6689] 2 exiting: rc = 0 00000100:00100000:2.0:1787853184.091287:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.091295:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.091300:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.091305:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.091333:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.091339:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.091344:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.091349:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.091354:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.091361:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.091366:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.091371:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.091377:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.091382:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.091387:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.091392:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.091397:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.091415:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.091422:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.091428:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.091434:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.091439:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.091444:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.091450:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.091456:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.091462:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.091468:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.091473:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.091479:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.091485:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.091490:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.091496:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.091501:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.091507:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.091513:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.091518:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.091524:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.091530:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.091535:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.091547:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.091553:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.091719:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.091728:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.091733:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.091739:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.091745:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.091751:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.091757:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.091762:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.091768:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.091774:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.091779:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.091785:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.091789:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.091795:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.091800:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.091806:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.091811:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.091817:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.091822:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.091827:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.091833:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.091839:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.091845:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.099843:0:6690:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff8f493c4f1200:6690] 0 exiting: rc = 1 00000100:00100000:3.0:1787853184.100064:0:6691:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff8f4934170000:6691] 1 exiting: rc = 0 00000100:00100000:0.0:1787853184.100275:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.100282:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.100288:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.100293:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.100298:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.100374:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.100380:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.100385:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.100390:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.100396:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.100401:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.100406:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.100411:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.100416:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.100421:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.100427:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.100432:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.100437:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.100442:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.100447:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.100452:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.100456:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.100461:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.100466:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.100470:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.100475:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.100479:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.100483:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.100488:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.100492:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.100497:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.100502:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.100506:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.100511:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.100515:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.100520:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.100525:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.100529:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.100533:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.100538:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.100548:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.100553:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.100558:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.100563:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.100590:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.100596:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.100602:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.100607:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.100612:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.100617:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.100623:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.100628:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.100633:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.100638:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.100643:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.100648:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.100653:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.100658:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.100662:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.100666:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.100671:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.100675:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.100679:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.100686:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853184.101915:0:6692:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff8f4921e6a000:6692] 0 exiting: rc = 1 00000100:00100000:1.0:1787853184.102009:0:6693:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff8f4921e6bc00:6693] 1 exiting: rc = 0 00000100:00100000:0.0:1787853184.102209:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.102217:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.102222:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.102229:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.102235:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.102241:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.102247:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.102253:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.102261:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.102280:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.102289:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.102303:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.102367:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.102374:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.102380:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.102386:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.102391:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.102399:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.102404:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.102410:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.102469:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.102490:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.102497:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.102502:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.102509:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.102515:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.102521:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.102526:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.102532:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.102537:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.102543:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.102548:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.102553:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.102759:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.102770:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.102776:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.102781:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.102786:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.102792:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.102798:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.102803:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.102808:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.102813:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.102818:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.102824:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.102845:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.102857:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.102862:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.102869:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.102875:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.102880:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.102887:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.102893:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.102899:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.102904:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.102910:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.102916:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.102936:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.102942:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.102948:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.102954:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.102960:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.102966:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853184.102972:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1787853184.115256:0:13236:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1787853202.229015:0:13851:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg401-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1787853212.329250:0:14311:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787853212.329255:0:14311:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1787853212.329369:0:14311:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8f493c6e5000 00000020:01000004:2.0:1787853212.329383:0:14311:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1787853212.329392:0:14311:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1787853212.329408:0:14311:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8f493ffe0000) 00000020:00000080:2.0:1787853212.329421:0:14311:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787853212.349531:0:14311:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1787853212.353267:0:14311:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:3.0:1787853212.353645:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 483: rc = 0 00100000:10000000:3.0:1787853212.353739:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 483: rc = 0 00100000:10000000:3.0:1787853212.353962:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 483: rc = 0 00100000:10000000:3.0:1787853212.354080:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 483: rc = 0 00100000:10000000:3.0:1787853212.354291:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 483: rc = 0 00100000:10000000:3.0:1787853212.354459:0:14311:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1787853212.354516:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 483: rc = 0 00100000:10000000:3.0:1787853212.354937:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 485: rc = 0 00100000:10000000:3.0:1787853212.357833:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 627: rc = 0 00100000:10000000:3.0:1787853212.357951:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 627: rc = 0 00100000:10000000:3.0:1787853212.358757:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 283: rc = 0 00100000:10000000:3.0:1787853212.359014:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 283: rc = 0 00100000:10000000:3.0:1787853212.359302:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 283: rc = 0 00100000:10000000:3.0:1787853212.359556:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 283: rc = 0 00100000:10000000:3.0:1787853212.360272:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 283: rc = 0 00100000:10000000:3.0:1787853212.361035:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 283: rc = 0 00100000:10000000:3.0:1787853212.361459:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 283: rc = 0 00100000:10000000:3.0:1787853212.361858:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 283: rc = 0 00100000:10000000:3.0:1787853212.362122:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 283: rc = 0 00100000:10000000:3.0:1787853212.362690:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 283: rc = 0 00100000:10000000:3.0:1787853212.362978:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 283: rc = 0 00100000:10000000:3.0:1787853212.363423:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 283: rc = 0 00100000:10000000:3.0:1787853212.364675:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 94: rc = 0 00100000:10000000:3.0:1787853212.364945:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 94: rc = 0 00100000:10000000:3.0:1787853212.365222:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 94: rc = 0 00100000:10000000:3.0:1787853212.365474:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 94: rc = 0 00100000:10000000:3.0:1787853212.365741:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 94: rc = 0 00100000:10000000:3.0:1787853212.366008:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 94: rc = 0 00100000:10000000:3.0:1787853212.366283:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 94: rc = 0 00100000:10000000:3.0:1787853212.366531:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 94: rc = 0 00100000:10000000:3.0:1787853212.366816:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 94: rc = 0 00100000:10000000:3.0:1787853212.367067:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 94: rc = 0 00100000:10000000:3.0:1787853212.367337:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 94: rc = 0 00100000:10000000:3.0:1787853212.367736:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 94: rc = 0 00100000:10000000:3.0:1787853212.368000:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 94: rc = 0 00100000:10000000:3.0:1787853212.368275:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 94: rc = 0 00100000:10000000:3.0:1787853212.368535:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 94: rc = 0 00100000:10000000:3.0:1787853212.368812:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 94: rc = 0 00100000:10000000:3.0:1787853212.369050:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 94: rc = 0 00100000:10000000:3.0:1787853212.369315:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 94: rc = 0 00100000:10000000:3.0:1787853212.369603:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 94: rc = 0 00100000:10000000:3.0:1787853212.369858:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 94: rc = 0 00100000:10000000:3.0:1787853212.370106:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 94: rc = 0 00100000:10000000:3.0:1787853212.370323:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 94: rc = 0 00100000:10000000:3.0:1787853212.370662:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 94: rc = 0 00100000:10000000:3.0:1787853212.370914:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 94: rc = 0 00100000:10000000:3.0:1787853212.371176:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 94: rc = 0 00100000:10000000:3.0:1787853212.371458:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 94: rc = 0 00100000:10000000:3.0:1787853212.371788:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 94: rc = 0 00100000:10000000:3.0:1787853212.372044:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 94: rc = 0 00100000:10000000:3.0:1787853212.372315:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 94: rc = 0 00100000:10000000:3.0:1787853212.372601:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 94: rc = 0 00100000:10000000:3.0:1787853212.372871:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 94: rc = 0 00100000:10000000:3.0:1787853212.373116:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 94: rc = 0 00100000:10000000:3.0:1787853212.373507:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 644: rc = 0 00100000:10000000:3.0:1787853212.374049:0:14311:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:3.0:1787853212.374249:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 628: rc = 0 00100000:10000000:3.0:1787853212.374444:0:14311:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:3.0:1787853212.374515:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 628: rc = 0 00100000:10000000:3.0:1787853212.374753:0:14311:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:3.0:1787853212.374821:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 628: rc = 0 00100000:10000000:3.0:1787853212.375180:0:14311:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:3.0:1787853212.375250:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 280: rc = 0 00100000:10000000:3.0:1787853212.375455:0:14311:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:3.0:1787853212.375523:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 280: rc = 0 00100000:10000000:3.0:1787853212.375759:0:14311:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:3.0:1787853212.375834:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 280: rc = 0 00000020:00000080:3.0:1787853212.376095:0:14311:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1787853212.376103:0:14311:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787853212.376110:0:14311:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x710df789068e7182 00000020:01000004:3.0:1787853212.376118:0:14311:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1787853212.376123:0:14311:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1787853212.376126:0:14311:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8f493c6e5000 from MGS 00000020:01000004:3.0:1787853212.376129:0:14311:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1787853212.376136:0:14311:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8f4941af8000) 00000020:00000080:3.0:1787853212.376145:0:14311:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1787853212.376218:0:14311:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f493c6e5000 from MGS, refs=2 00080000:01000000:3.0:1787853212.376224:0:14311:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787853212.376229:0:14311:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x710df789068e7190 00000100:00100000:3.0:1787853212.376332:0:14311:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1787853212.376468:0:14311:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1787853212.376475:0:14311:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1787853212.376920:0:14311:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1787853212.376927:0:14311:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1787853212.377922:0:14311:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787853212.378072:0:14311:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1787853212.378078:0:14311:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1787853212.379359:0:14311:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1787853212.379367:0:14311:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1787853212.379917:0:14311:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1787853212.379923:0:14311:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1787853212.380439:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853212.380442:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853212.380444:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853212.380860:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853212.380863:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853212.380864:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787853212.381349:0:14311:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1787853212.384975:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1787853212.395237:0:14311:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1787853212.395262:0:14311:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787853212.395265:0:14311:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1787853212.398142:0:14320:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1787853212.398319:0:14311:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1787853212.398485:0:14311:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787853212.399265:0:14311:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1787853212.399676:0:14311:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787853212.403994:0:14311:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1787853212.404005:0:14311:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1787853212.408789:0:14311:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1787853212.408800:0:14311:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1787853212.414945:0:14311:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1787853212.414967:0:14311:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1787853212.415944:0:14311:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1787853212.415965:0:14311:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.101@tcp' 00000020:01000004:2.0:1787853212.415967:0:14311:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1787853212.415998:0:14311:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.101@tcp (typ=mgc) 00000020:00000080:2.0:1787853212.416011:0:14311:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.101@tcp (ffff8f493ffe4d70) 00000020:00000080:2.0:1787853212.416026:0:14311:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1787853212.416102:0:14311:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f491230b800@MGC192.168.204.101@tcp: add connection 192.168.204.101@tcp at head 00010000:00010000:2.0:1787853212.416280:0:14311:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.101@tcp-0 is initialized 00000040:01000000:2.0:1787853212.416286:0:14311:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.101@tcp ctxt 1 is initialized 00000100:00080000:3.0:1787853212.416695:0:14325:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1787853212.417197:0:14326:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1787853212.417269:0:14311:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.101@tcp (uuid a76e730b-0783-4789-a5e2-a4230bb4bd66) 00000020:00000080:3.0:1787853212.417292:0:14311:0:(genops.c:1385:class_connect()) connect: client a76e730b-0783-4789-a5e2-a4230bb4bd66, cookie 0x710df789068e719e 00000100:00080000:3.0:1787853212.417312:0:14311:0:(import.c:510:import_select_connection()) MGC192.168.204.101@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787853212.417318:0:14311:0:(import.c:624:import_select_connection()) MGC192.168.204.101@tcp: import ffff8f491230b800 using connection 192.168.204.101@tcp/0@lo 00000100:00100000:3.0:1787853212.417351:0:14311:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f4934117840 x1874699552387456/t0(0) o250->MGC192.168.204.101@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787853212.417384:0:14311:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import a76e730b-0783-4789-a5e2-a4230bb4bd66->MGS 00000020:01000004:3.0:1787853212.417405:0:14311:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1787853212.417410:0:14311:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1787853212.417422:0:14311:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff8f4941afcd70) 00000020:00000080:3.0:1787853212.417432:0:14311:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1787853212.417703:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4934117840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a76e730b-0783-4789-a5e2-a4230bb4bd66:3305:1874699552387456:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1787853212.417789:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853212.417858:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552387456 00000100:00100000:2.0:1787853212.417865:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552387456 00000100:00100000:2.0:1787853212.417898:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787853212.417905:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f48019c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3305:x1874699552387456:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1787853212.417928:0:14322:0:(ldlm_lib.c:1454:target_handle_connect()) MGS: connection from a76e730b-0783-4789-a5e2-a4230bb4bd66@0@lo t0 exp 0000000000000000 cur 531 last 0 00000020:00000080:2.0:1787853212.417948:0:14322:0:(genops.c:1385:class_connect()) connect: client a76e730b-0783-4789-a5e2-a4230bb4bd66, cookie 0x710df789068e71ac 00000100:00080000:2.0:1787853212.418061:0:14322:0:(import.c:65:import_set_state_nolock()) ffff8f4911ea9800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787853212.418107:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f48019c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a76e730b-0783-4789-a5e2-a4230bb4bd66+5:3305:x1874699552387456:12345-0@lo:250:mount.lustre.0 Request processed in 200us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853212.418114:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787853212.418170:0:3305:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.204.101@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1787853212.418179:0:3305:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.204.101@tcp: connect to target with instance 0 00000100:00080000:2.0:1787853212.418185:0:3305:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.204.101@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1787853212.418189:0:3305:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1787853212.418192:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8f491230b800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1787853212.418194:0:3305:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1787853212.418202:0:3305:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1787853212.418206:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4934117840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a76e730b-0783-4789-a5e2-a4230bb4bd66:3305:1874699552387456:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1787853212.435909:0:14311:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787853212.436104:0:14311:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1787853212.436110:0:14311:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1787853212.452422:0:14311:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1787853212.452438:0:14311:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1787853212.455911:0:14311:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1787853212.455927:0:14311:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1787853212.456989:0:14311:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787853212.457199:0:14311:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1787853212.457204:0:14311:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1787853212.462118:0:14311:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1787853212.462146:0:14311:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1787853212.539026:0:14311:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787853212.539528:0:14311:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1787853212.539536:0:14311:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1787853212.542656:0:14311:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1787853212.542668:0:14311:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1787853212.543505:0:14311:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787853212.543886:0:14311:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787853212.543949:0:14311:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1787853212.544399:0:14311:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787853212.544405:0:14311:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1787853212.545035:0:14311:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787853212.545244:0:14311:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787853212.545249:0:14311:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1787853212.550038:0:14311:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787853212.550053:0:14311:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1787853212.550686:0:14311:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787853212.550930:0:14311:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787853212.550935:0:14311:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1787853212.551660:0:14311:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787853212.551668:0:14311:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1787853212.596432:0:14311:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787853212.597855:0:14311:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1787853212.597863:0:14311:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1787853212.602521:0:14311:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1787853212.602545:0:14311:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1787853212.607470:0:14311:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1787853212.607493:0:14311:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1787853212.609640:0:14311:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1787853212.609673:0:14311:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1787853212.609681:0:14311:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.101@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1787853212.609992:0:14311:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.101@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787853212.610029:0:14311:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.101@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1787853212.610034:0:14311:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787853212.610036:0:14311:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787853212.610037:0:14311:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787853212.610038:0:14311:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787853212.610040:0:14311:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787853212.610041:0:14311:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787853212.610042:0:14311:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787853212.610044:0:14311:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787853212.610046:0:14311:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787853212.610048:0:14311:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787853212.610050:0:14311:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1787853212.610052:0:14311:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787853212.610053:0:14311:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787853212.610055:0:14311:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787853212.610056:0:14311:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787853212.610057:0:14311:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787853212.610058:0:14311:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787853212.610059:0:14311:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787853212.610060:0:14311:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787853212.610061:0:14311:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787853212.610062:0:14311:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787853212.610090:0:14311:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1787853212.610111:0:14311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4803e65680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a76e730b-0783-4789-a5e2-a4230bb4bd66:14311:1874699552387584:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787853212.610220:0:14311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853212.610332:0:14311:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f493c152540 going to sleep for 11 seconds 00000100:00100000:0.0:1787853212.613296:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552387584 00000100:00100000:0.0:1787853212.613312:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552387584 00000100:00100000:0.0:1787853212.613506:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787853212.613518:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f48019ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a76e730b-0783-4789-a5e2-a4230bb4bd66+5:14311:x1874699552387584:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787853212.613597:0:14324:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787853212.613601:0:14324:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1787853212.613605:0:14324:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1787853212.614329:0:14345:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1787853212.615011:0:14324:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:0.0:1787853212.618669:0:14346:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1787853212.618679:0:14346:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1787853212.618682:0:14346:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1787853212.618733:0:14346:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:3.0:1787853212.619174:0:14324:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787853212.619191:0:14324:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1787853212.652685:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f48019ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a76e730b-0783-4789-a5e2-a4230bb4bd66+5:14311:x1874699552387584:12345-0@lo:253:mount.lustre.0 Request processed in 39160us (42455us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853212.652706:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787853212.653000:0:14311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4803e65680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a76e730b-0783-4789-a5e2-a4230bb4bd66:14311:1874699552387584:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787853212.653016:0:14311:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1787853212.653019:0:14311:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787853212.653021:0:14311:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787853212.653022:0:14311:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787853212.653024:0:14311:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787853212.653025:0:14311:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787853212.653027:0:14311:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787853212.653029:0:14311:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787853212.653030:0:14311:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787853212.653033:0:14311:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787853212.653034:0:14311:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787853212.653051:0:14311:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8f493c6e5000 from lustre-MDT0000 10000000:01000000:0.0:1787853212.653073:0:14311:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1787853212.653076:0:14311:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1787853212.653081:0:14311:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8f493ffe4d70 10000000:01000000:0.0:1787853212.653085:0:14311:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787853212.653105:0:14311:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8f493ffe4d70 from 1 10000000:01000000:0.0:1787853212.653108:0:14311:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787853212.653158:0:14311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f49415b6600/0x710df789068e71b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853212.653170:0:14311:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.101@tcp lock: ffff8f49415b6600/0x710df789068e71b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853212.653180:0:14311:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: ffff8f49415b6600/0x710df789068e71b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853212.653200:0:14311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49092bda40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a76e730b-0783-4789-a5e2-a4230bb4bd66:14311:1874699552387712:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787853212.653236:0:14311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853212.653277:0:14311:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f493c154540 going to sleep for 11 seconds 00000100:00100000:1.0:1787853212.653504:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552387712 00000100:00100000:1.0:1787853212.653511:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552387712 00000100:00100000:1.0:1787853212.653647:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787853212.653667:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f48019cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a76e730b-0783-4789-a5e2-a4230bb4bd66+5:14311:x1874699552387712:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787853212.653711:0:14323:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853212.653733:0:14323:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f492a8ad000/0x710df789068e71ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x710df789068e71b3 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853212.653780:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f492a8ad000/0x710df789068e71ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x710df789068e71b3 expref: 6 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853212.654078:0:14323:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f492a8ad000/0x710df789068e71ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x710df789068e71b3 expref: 6 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853212.654104:0:14323:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f492a8ad000, rc 0) 00000100:00100000:1.0:1787853212.654182:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f48019cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a76e730b-0783-4789-a5e2-a4230bb4bd66+6:14311:x1874699552387712:12345-0@lo:101:mount.lustre.0 Request processed in 528us (945us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853212.654189:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787853212.654466:0:14311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49092bda40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a76e730b-0783-4789-a5e2-a4230bb4bd66:14311:1874699552387712:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787853212.654506:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: ffff8f49415b6600/0x710df789068e71b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e71ba expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853212.654516:0:14311:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: ffff8f49415b6600/0x710df789068e71b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x710df789068e71ba expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853212.654649:0:14311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49092bda40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a76e730b-0783-4789-a5e2-a4230bb4bd66:14311:1874699552387840:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787853212.654690:0:14311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853212.654741:0:14311:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f493c154540 going to sleep for 11 seconds 00000100:00100000:2.0:1787853212.655087:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552387840 00000100:00100000:2.0:1787853212.655118:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552387840 00000100:00100000:2.0:1787853212.655187:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787853212.655195:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f48019cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a76e730b-0783-4789-a5e2-a4230bb4bd66+6:14311:x1874699552387840:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787853212.655554:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f48019cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a76e730b-0783-4789-a5e2-a4230bb4bd66+6:14311:x1874699552387840:12345-0@lo:501:mount.lustre.0 Request processed in 348us (851us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787853212.655562:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787853212.656967:0:14311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49092bda40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a76e730b-0783-4789-a5e2-a4230bb4bd66:14311:1874699552387840:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1787853212.657017:0:14311:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.101@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787853212.657031:0:14311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f49415b6600/0x710df789068e71b3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e71ba expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853212.657042:0:14311:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: ffff8f49415b6600/0x710df789068e71b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e71ba expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787853212.657051:0:14311:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8f493c6e5000 10000000:01000000:0.0:1787853212.657058:0:14311:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787853212.657063:0:14311:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8f493c6e5000 10000000:01000000:0.0:1787853212.657066:0:14311:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1787853212.657069:0:14311:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8f493c6e5000 from 1 10000000:01000000:0.0:1787853212.657071:0:14311:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1787853212.657129:0:14311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f49415b6200/0x710df789068e71c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853212.657137:0:14311:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.101@tcp lock: ffff8f49415b6200/0x710df789068e71c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853212.657182:0:14311:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: ffff8f49415b6200/0x710df789068e71c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853212.657210:0:14311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49092bda40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a76e730b-0783-4789-a5e2-a4230bb4bd66:14311:1874699552387968:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787853212.657257:0:14311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853212.657301:0:14311:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f493c154540 going to sleep for 11 seconds 00000100:00100000:3.0:1787853212.657725:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552387968 00000100:00100000:3.0:1787853212.657731:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552387968 00000100:00100000:3.0:1787853212.657772:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787853212.657780:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f48019cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a76e730b-0783-4789-a5e2-a4230bb4bd66+6:14311:x1874699552387968:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787853212.657804:0:14322:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853212.657819:0:14322:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f4921e21800/0x710df789068e71c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x710df789068e71c1 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853212.657859:0:14322:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f4921e21800/0x710df789068e71c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x710df789068e71c1 expref: 7 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853212.657878:0:14322:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f4921e21800/0x710df789068e71c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x710df789068e71c1 expref: 7 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853212.657887:0:14322:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4921e21800, rc 0) 00000100:00100000:3.0:1787853212.657948:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f48019cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a76e730b-0783-4789-a5e2-a4230bb4bd66+7:14311:x1874699552387968:12345-0@lo:101:mount.lustre.0 Request processed in 169us (690us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853212.657955:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787853212.660133:0:14311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49092bda40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a76e730b-0783-4789-a5e2-a4230bb4bd66:14311:1874699552387968:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787853212.660187:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: ffff8f49415b6200/0x710df789068e71c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e71c8 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853212.660207:0:14311:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: ffff8f49415b6200/0x710df789068e71c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x710df789068e71c8 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787853212.660240:0:14311:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.101@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1787853212.660246:0:14311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f49415b6200/0x710df789068e71c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e71c8 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853212.660254:0:14311:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: ffff8f49415b6200/0x710df789068e71c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e71c8 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787853212.660261:0:14311:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1787853212.660277:0:14311:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787853212.660283:0:14311:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8f493c6e5000 10000000:01000000:0.0:1787853212.660285:0:14311:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1787853212.660289:0:14311:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1787853212.660291:0:14311:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787853212.660335:0:14311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f49415b6a00/0x710df789068e71cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853212.660363:0:14311:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.101@tcp lock: ffff8f49415b6a00/0x710df789068e71cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853212.660374:0:14311:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: ffff8f49415b6a00/0x710df789068e71cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853212.660400:0:14311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49092bda40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a76e730b-0783-4789-a5e2-a4230bb4bd66:14311:1874699552388096:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787853212.660474:0:14311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853212.660508:0:14311:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f493c154540 going to sleep for 11 seconds 00000100:00100000:1.0:1787853212.660634:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552388096 00000100:00100000:1.0:1787853212.660648:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552388096 00000100:00100000:1.0:1787853212.660706:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787853212.660715:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f48019ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a76e730b-0783-4789-a5e2-a4230bb4bd66+7:14311:x1874699552388096:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787853212.660726:0:14322:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853212.660766:0:14322:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f492a8ad600/0x710df789068e71d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x710df789068e71cf expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853212.660794:0:14322:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f492a8ad600/0x710df789068e71d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x710df789068e71cf expref: 8 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853212.660804:0:14322:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f492a8ad600/0x710df789068e71d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x710df789068e71cf expref: 8 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853212.660813:0:14322:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f492a8ad600, rc 0) 00000100:00100000:1.0:1787853212.660871:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f48019ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a76e730b-0783-4789-a5e2-a4230bb4bd66+8:14311:x1874699552388096:12345-0@lo:101:mount.lustre.0 Request processed in 157us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853212.660888:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787853212.661472:0:14311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49092bda40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a76e730b-0783-4789-a5e2-a4230bb4bd66:14311:1874699552388096:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787853212.661503:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: ffff8f49415b6a00/0x710df789068e71cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e71d6 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853212.661512:0:14311:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: ffff8f49415b6a00/0x710df789068e71cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x710df789068e71d6 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853212.661633:0:14311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49092bda40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a76e730b-0783-4789-a5e2-a4230bb4bd66:14311:1874699552388224:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787853212.661672:0:14311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853212.661702:0:14311:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f493c154540 going to sleep for 11 seconds 00000100:00100000:1.0:1787853212.663379:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552388224 00000100:00100000:1.0:1787853212.663412:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552388224 00000100:00100000:1.0:1787853212.663507:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787853212.663528:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f48019c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a76e730b-0783-4789-a5e2-a4230bb4bd66+8:14311:x1874699552388224:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787853212.664382:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f48019c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a76e730b-0783-4789-a5e2-a4230bb4bd66+9:14311:x1874699552388224:12345-0@lo:501:mount.lustre.0 Request processed in 854us (2707us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853212.664403:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787853212.665476:0:14311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49092bda40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a76e730b-0783-4789-a5e2-a4230bb4bd66:14311:1874699552388224:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787853212.665553:0:14311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49092bda40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a76e730b-0783-4789-a5e2-a4230bb4bd66:14311:1874699552388352:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787853212.665700:0:14311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853212.665731:0:14311:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f493c154540 going to sleep for 11 seconds 00000100:00100000:1.0:1787853212.668156:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552388352 00000100:00100000:1.0:1787853212.668171:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552388352 00000100:00100000:1.0:1787853212.668230:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787853212.668240:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f48019c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a76e730b-0783-4789-a5e2-a4230bb4bd66+9:14311:x1874699552388352:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787853212.668677:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f48019c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a76e730b-0783-4789-a5e2-a4230bb4bd66+9:14311:x1874699552388352:12345-0@lo:503:mount.lustre.0 Request processed in 437us (2976us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853212.668685:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787853212.669300:0:14311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49092bda40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a76e730b-0783-4789-a5e2-a4230bb4bd66:14311:1874699552388352:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787853212.669713:0:14347:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49092bda40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a76e730b-0783-4789-a5e2-a4230bb4bd66:14347:1874699552388480:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787853212.669777:0:14347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853212.669811:0:14347:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f493c154e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787853212.670017:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552388480 00000100:00100000:1.0:1787853212.670023:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552388480 00000100:00100000:1.0:1787853212.670063:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787853212.670071:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f48019c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a76e730b-0783-4789-a5e2-a4230bb4bd66+9:14347:x1874699552388480:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787853212.672741:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f48019c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a76e730b-0783-4789-a5e2-a4230bb4bd66+9:14347:x1874699552388480:12345-0@lo:502:llog_process_th.0 Request processed in 2660us (2953us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853212.672789:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787853212.673052:0:14347:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49092bda40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a76e730b-0783-4789-a5e2-a4230bb4bd66:14347:1874699552388480:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787853212.673086:0:14347:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787853212.673489:0:14347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787853212.673493:0:14347:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787853212.673499:0:14347:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1787853212.673501:0:14347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787853212.673517:0:14347:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8f49415e0000) 00000020:00000080:0.0:1787853212.673539:0:14347:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1787853212.673544:0:14347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1787853212.673654:0:14347:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:0.0:1787853212.673661:0:14347:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x710df789068e71e4 00000020:00000080:0.0:1787853212.673907:0:14347:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1787853212.673911:0:14347:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787853212.673915:0:14347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787853212.673916:0:14347:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787853212.673919:0:14347:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787853212.673922:0:14347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787853212.673924:0:14347:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1787853212.673934:0:14347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787853212.673941:0:14347:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8f49415e4d70) 00000020:00000080:0.0:1787853212.673950:0:14347:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1787853212.673953:0:14347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1787853212.673956:0:14347:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1787853212.673958:0:14347:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1787853212.673964:0:14347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787853212.674003:0:14347:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f493c6e5000 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1787853212.674015:0:14347:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8f49415e19d0) 00000020:00000080:0.0:1787853212.674023:0:14347:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1787853212.674065:0:14347:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1787853212.674081:0:14347:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x710df789068e71f9 00000020:00000080:0.0:1787853212.674189:0:14347:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1787853212.674195:0:14347:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1787853212.674199:0:14347:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x710df789068e7200 00080000:01000000:0.0:1787853212.674204:0:14347:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:0.0:1787853212.674207:0:14347:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x710df789068e7207 00010000:00010000:2.0:1787853212.769312:0:14347:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1787853212.769815:0:14347:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:2.0:1787853212.770022:0:14347:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1787853212.770701:0:14347:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8f493ffe19d0) 00000020:00000080:2.0:1787853212.770722:0:14347:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1787853212.770800:0:14347:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:2.0:1787853212.770808:0:14347:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x710df789068e7215 00000020:00000080:3.0:1787853212.772454:0:14347:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1787853212.775857:0:14347:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x710df789068e721c 00000020:00000080:3.0:1787853212.777971:0:14347:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1787853212.777986:0:14347:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787853212.777993:0:14347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787853212.777996:0:14347:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1787853212.778000:0:14347:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787853212.778004:0:14347:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:3.0:1787853212.778006:0:14347:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787853212.778008:0:14347:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787853212.778010:0:14347:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787853212.778012:0:14347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787853212.778026:0:14347:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787853212.778029:0:14347:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787853212.778047:0:14347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787853212.778049:0:14347:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1787853212.778054:0:14347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1787853212.778099:0:14347:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1787853212.778114:0:14347:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787853212.778118:0:14347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787853212.778119:0:14347:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1787853212.778122:0:14347:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787853212.778126:0:14347:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1787853212.778129:0:14347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787853212.778130:0:14347:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1787853212.778133:0:14347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787853212.778138:0:14347:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.101@tcp to nid 0x20000c0a8cc65 (192.168.204.101@tcp) 00000020:01000000:3.0:1787853212.778173:0:14347:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1787853212.778176:0:14347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787853212.778192:0:14347:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8f4941af99d0) 00000020:00000080:3.0:1787853212.778209:0:14347:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1787853212.778214:0:14347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787853212.778265:0:14347:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1787853212.778270:0:14347:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:3.0:1787853212.778276:0:14347:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x710df789068e722a 00010000:00080000:3.0:1787853212.778306:0:14347:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f4908b0a000@lustre-OST0000-osc-MDT0000: add connection 192.168.204.101@tcp at head 00010000:00010000:3.0:1787853212.779256:0:14347:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:3.0:1787853212.781074:0:14347:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1787853212.781124:0:14347:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1787853212.794841:0:14347:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787853212.794986:0:14347:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1787853212.795073:0:14347:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1787853212.797829:0:14351:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787853212.797836:0:14351:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1787853212.802855:0:14347:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787853212.802871:0:14347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787853212.802922:0:14347:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1787853212.802941:0:14347:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x710df789068e7231 00000100:00080000:3.0:1787853212.802952:0:14347:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787853212.802958:0:14347:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8f4908b0a000 using connection 192.168.204.101@tcp/0@lo 00000100:00100000:3.0:1787853212.803002:0:14347:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f49341170c0 x1874699552388608/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787853212.803026:0:14347:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1787853212.803090:0:14347:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787853212.803095:0:14347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787853212.803096:0:14347:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1787853212.803099:0:14347:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787853212.803102:0:14347:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1787853212.803103:0:14347:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787853212.803105:0:14347:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787853212.803106:0:14347:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787853212.803109:0:14347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787853212.803110:0:14347:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787853212.803113:0:14347:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787853212.803117:0:14347:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1787853212.803121:0:14347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787853212.803122:0:14347:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1787853212.803125:0:14347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787853212.803128:0:14347:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.101@tcp to nid 0x20000c0a8cc65 (192.168.204.101@tcp) 00000020:01000000:3.0:1787853212.803162:0:14347:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1787853212.803165:0:14347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787853212.803177:0:14347:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8f4941afb3a0) 00000020:00000080:3.0:1787853212.803189:0:14347:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1787853212.803193:0:14347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787853212.803248:0:14347:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1787853212.803260:0:14347:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:3.0:1787853212.803267:0:14347:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x710df789068e723f 00010000:00080000:3.0:1787853212.803301:0:14347:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f4911cd3800@lustre-OST0001-osc-MDT0000: add connection 192.168.204.101@tcp at head 00000100:00100000:2.0:1787853212.803791:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49341170c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1874699552388608:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1787853212.803843:0:3305:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874699552388608 offset 0 length 520: 4 00010000:00010000:0.0:1787853212.806680:0:14347:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:0.0:1787853212.807238:0:14347:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1787853212.807266:0:14347:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1787853212.810822:0:14347:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787853212.813234:0:14347:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:0.0:1787853212.813347:0:14347:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:1.0:1787853212.816817:0:14353:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787853212.816826:0:14353:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1787853212.817675:0:14347:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787853212.817693:0:14347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787853212.817728:0:14347:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1787853212.817748:0:14347:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x710df789068e7246 00000100:00080000:2.0:1787853212.817759:0:14347:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787853212.817764:0:14347:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8f4911cd3800 using connection 192.168.204.101@tcp/0@lo 00000100:00100000:2.0:1787853212.817800:0:14347:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f492eb8a580 x1874699552388736/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787853212.817828:0:14347:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1787853212.818063:0:14347:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787853212.818068:0:14347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787853212.818070:0:14347:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1787853212.818073:0:14347:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787853212.818077:0:14347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787853212.818078:0:14347:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787853212.818081:0:14347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787853212.818083:0:14347:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787853212.818085:0:14347:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787853212.818087:0:14347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787853212.818089:0:14347:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:2.0:1787853212.818091:0:14347:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787853212.818093:0:14347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787853212.818095:0:14347:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787853212.818099:0:14347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1787853212.818132:0:14347:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f492eb892c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a76e730b-0783-4789-a5e2-a4230bb4bd66:14347:1874699552388864:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787853212.818221:0:14347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853212.818260:0:14347:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f49064fa240 going to sleep for 11 seconds 00000100:00100000:0.0:1787853212.818347:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f492eb8a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1874699552388736:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1787853212.818388:0:3305:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874699552388736 offset 0 length 520: 4 00000100:00100000:3.0:1787853212.818786:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552388864 00000100:00100000:3.0:1787853212.818793:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552388864 00000100:00100000:3.0:1787853212.818836:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787853212.818845:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f48019c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a76e730b-0783-4789-a5e2-a4230bb4bd66+9:14347:x1874699552388864:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787853212.819100:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f48019c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a76e730b-0783-4789-a5e2-a4230bb4bd66+9:14347:x1874699552388864:12345-0@lo:502:llog_process_th.0 Request processed in 256us (879us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853212.819109:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787853212.819361:0:14347:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f492eb892c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a76e730b-0783-4789-a5e2-a4230bb4bd66:14347:1874699552388864:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787853212.819395:0:14347:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787853212.819401:0:14347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787853212.819403:0:14347:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787853212.819413:0:14347:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1787853212.822022:0:14311:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:0.0:1787853212.822204:0:14311:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.101@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787853212.822264:0:14311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f49415b6a00/0x710df789068e71cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e71d6 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853212.822279:0:14311:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: ffff8f49415b6a00/0x710df789068e71cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e71d6 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787853212.822287:0:14311:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8f493c6e5000 from 1 10000000:01000000:0.0:1787853212.822291:0:14311:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787853212.822334:0:14311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f49415b7400/0x710df789068e724d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853212.822353:0:14311:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.101@tcp lock: ffff8f49415b7400/0x710df789068e724d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853212.822364:0:14311:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: ffff8f49415b7400/0x710df789068e724d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853212.822409:0:14311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49092bda40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a76e730b-0783-4789-a5e2-a4230bb4bd66:14311:1874699552388992:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787853212.822481:0:14311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853212.822517:0:14311:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f48027e56c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787853212.823335:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552388992 00000100:00100000:1.0:1787853212.823354:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552388992 00000100:00100000:1.0:1787853212.823420:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787853212.823431:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493dc1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a76e730b-0783-4789-a5e2-a4230bb4bd66+9:14311:x1874699552388992:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787853212.823444:0:14323:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853212.823461:0:14323:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f492a8ace00/0x710df789068e7254 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x710df789068e724d expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853212.823498:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f492a8ace00/0x710df789068e7254 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x710df789068e724d expref: 10 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853212.823508:0:14323:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f492a8ace00/0x710df789068e7254 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x710df789068e724d expref: 10 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853212.823517:0:14323:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f492a8ace00, rc 0) 00000100:00100000:1.0:1787853212.823617:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493dc1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a76e730b-0783-4789-a5e2-a4230bb4bd66+10:14311:x1874699552388992:12345-0@lo:101:mount.lustre.0 Request processed in 188us (1136us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853212.823624:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787853212.823978:0:14311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49092bda40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a76e730b-0783-4789-a5e2-a4230bb4bd66:14311:1874699552388992:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787853212.823995:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: ffff8f49415b7400/0x710df789068e724d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e7254 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853212.824006:0:14311:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: ffff8f49415b7400/0x710df789068e724d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x710df789068e7254 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853212.826299:0:14311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49092bda40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a76e730b-0783-4789-a5e2-a4230bb4bd66:14311:1874699552389120:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1787853212.827216:0:14311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853212.827262:0:14311:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f48027e56c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787853212.827839:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552389120 00000100:00100000:1.0:1787853212.827848:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552389120 00000100:00100000:1.0:1787853212.827901:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787853212.827909:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493dc1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a76e730b-0783-4789-a5e2-a4230bb4bd66+10:14311:x1874699552389120:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1787853212.827931:0:14324:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1787853212.827936:0:14324:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1787853212.828015:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493dc1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a76e730b-0783-4789-a5e2-a4230bb4bd66+10:14311:x1874699552389120:12345-0@lo:256:mount.lustre.0 Request processed in 106us (1638us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853212.828022:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787853212.828785:0:14311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49092bda40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a76e730b-0783-4789-a5e2-a4230bb4bd66:14311:1874699552389120:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1787853212.832952:0:14311:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787853212.832984:0:14311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f49415b7400/0x710df789068e724d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e7254 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853212.832998:0:14311:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: ffff8f49415b7400/0x710df789068e724d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e7254 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787853212.833006:0:14311:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f493c6e5000 from 1 10000000:01000000:0.0:1787853212.833009:0:14311:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787853212.833054:0:14311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f49415b7800/0x710df789068e725b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853212.833076:0:14311:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.101@tcp lock: ffff8f49415b7800/0x710df789068e725b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853212.833099:0:14311:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: ffff8f49415b7800/0x710df789068e725b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853212.833132:0:14311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49092bda40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a76e730b-0783-4789-a5e2-a4230bb4bd66:14311:1874699552389248:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787853212.833216:0:14311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853212.833253:0:14311:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f48027e56c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787853212.833442:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552389248 00000100:00100000:1.0:1787853212.833451:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552389248 00000100:00100000:1.0:1787853212.833509:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787853212.833526:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493dc1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a76e730b-0783-4789-a5e2-a4230bb4bd66+10:14311:x1874699552389248:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787853212.833541:0:14323:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853212.833554:0:14323:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f492a8acc00/0x710df789068e7262 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x710df789068e725b expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853212.833605:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f492a8acc00/0x710df789068e7262 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x710df789068e725b expref: 11 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853212.833618:0:14323:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f492a8acc00/0x710df789068e7262 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x710df789068e725b expref: 11 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853212.833626:0:14323:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f492a8acc00, rc 0) 00000100:00100000:2.0:1787853212.836266:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493dc1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a76e730b-0783-4789-a5e2-a4230bb4bd66+11:14311:x1874699552389248:12345-0@lo:101:mount.lustre.0 Request processed in 2731us (3039us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853212.836279:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787853212.836688:0:14311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49092bda40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a76e730b-0783-4789-a5e2-a4230bb4bd66:14311:1874699552389248:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787853212.836715:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: ffff8f49415b7800/0x710df789068e725b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e7262 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853212.836728:0:14311:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: ffff8f49415b7800/0x710df789068e725b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x710df789068e7262 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853212.836813:0:14311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49092bda40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a76e730b-0783-4789-a5e2-a4230bb4bd66:14311:1874699552389376:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787853212.836849:0:14311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853212.836884:0:14311:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f48027e56c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787853212.837262:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552389376 00000100:00100000:3.0:1787853212.837270:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552389376 00000100:00100000:3.0:1787853212.837308:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787853212.837316:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493dc1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a76e730b-0783-4789-a5e2-a4230bb4bd66+11:14311:x1874699552389376:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787853212.837881:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493dc1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a76e730b-0783-4789-a5e2-a4230bb4bd66+11:14311:x1874699552389376:12345-0@lo:501:mount.lustre.0 Request processed in 564us (1030us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853212.838220:0:14311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49092bda40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a76e730b-0783-4789-a5e2-a4230bb4bd66:14311:1874699552389376:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787853212.838258:0:14311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4803e670c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a76e730b-0783-4789-a5e2-a4230bb4bd66:14311:1874699552389504:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787853212.838298:0:14311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853212.838328:0:14311:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f4902af1d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787853212.838379:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552389504 00000100:00100000:2.0:1787853212.838384:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552389504 00000100:00100000:2.0:1787853212.838412:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787853212.838432:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493dc1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a76e730b-0783-4789-a5e2-a4230bb4bd66+12:14311:x1874699552389504:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787853212.838616:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493dc1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a76e730b-0783-4789-a5e2-a4230bb4bd66+12:14311:x1874699552389504:12345-0@lo:503:mount.lustre.0 Request processed in 186us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853212.838624:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787853212.838760:0:14311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4803e670c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a76e730b-0783-4789-a5e2-a4230bb4bd66:14311:1874699552389504:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787853212.838955:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787853212.839541:0:14355:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49092bd2c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a76e730b-0783-4789-a5e2-a4230bb4bd66:14355:1874699552389632:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787853212.839622:0:14355:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853212.839648:0:14355:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f48027e5540 going to sleep for 11 seconds 00000100:00100000:2.0:1787853212.839728:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552389632 00000100:00100000:2.0:1787853212.839733:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552389632 00000100:00100000:2.0:1787853212.839764:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787853212.839771:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493dc1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a76e730b-0783-4789-a5e2-a4230bb4bd66+11:14355:x1874699552389632:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787853212.840368:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493dc1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a76e730b-0783-4789-a5e2-a4230bb4bd66+11:14355:x1874699552389632:12345-0@lo:502:llog_process_th.0 Request processed in 595us (743us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853212.840377:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787853212.841219:0:14355:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49092bd2c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a76e730b-0783-4789-a5e2-a4230bb4bd66:14355:1874699552389632:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787853212.841259:0:14355:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787853212.841269:0:14355:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787853212.841276:0:14355:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787853212.841283:0:14355:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f493c6e5000 00000020:00000080:0.0:1787853212.841287:0:14355:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787853212.841296:0:14355:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787853212.841298:0:14355:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787853212.841299:0:14355:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1787853212.841301:0:14355:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787853212.841303:0:14355:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787853212.841305:0:14355:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787853212.841308:0:14355:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f493c6e5000 00000020:00000080:0.0:1787853212.841310:0:14355:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787853212.841374:0:14355:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787853212.841377:0:14355:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787853212.841378:0:14355:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1787853212.841380:0:14355:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787853212.841382:0:14355:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787853212.841384:0:14355:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787853212.841387:0:14355:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8f493c6e5000 00000020:00000080:0.0:1787853212.841389:0:14355:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787853212.841489:0:14355:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49092bd2c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a76e730b-0783-4789-a5e2-a4230bb4bd66:14355:1874699552389760:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787853212.841536:0:14355:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853212.843204:0:14355:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f48027e5540 going to sleep for 11 seconds 00000100:00100000:1.0:1787853212.849756:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552389760 00000100:00100000:1.0:1787853212.849773:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552389760 00000100:00100000:1.0:1787853212.849835:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787853212.849845:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493dc1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a76e730b-0783-4789-a5e2-a4230bb4bd66+11:14355:x1874699552389760:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787853212.852178:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493dc1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a76e730b-0783-4789-a5e2-a4230bb4bd66+11:14355:x1874699552389760:12345-0@lo:502:llog_process_th.0 Request processed in 2323us (10630us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853212.852195:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787853212.852722:0:14355:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49092bd2c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a76e730b-0783-4789-a5e2-a4230bb4bd66:14355:1874699552389760:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787853212.852761:0:14355:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787853212.852769:0:14355:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787853212.852771:0:14355:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1787853212.852777:0:14355:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1787853212.854318:0:14311:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1787853212.854365:0:14311:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787853212.854399:0:14311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f49415b7800/0x710df789068e725b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e7262 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853212.854412:0:14311:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: ffff8f49415b7800/0x710df789068e725b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e7262 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787853212.854459:0:14311:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787853212.854463:0:14311:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8f493c6e5000 10000000:01000000:1.0:1787853212.854466:0:14311:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8f493c6e5000 10000000:01000000:1.0:1787853212.854470:0:14311:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787853212.854477:0:14311:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8f493c6e5000 from 1 10000000:01000000:1.0:1787853212.854480:0:14311:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787853212.854520:0:14311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f492a8ac000/0x710df789068e7269 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853212.854530:0:14311:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.101@tcp lock: ffff8f492a8ac000/0x710df789068e7269 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853212.854540:0:14311:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: ffff8f492a8ac000/0x710df789068e7269 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853212.854564:0:14311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4803e670c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a76e730b-0783-4789-a5e2-a4230bb4bd66:14311:1874699552389888:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787853212.854646:0:14311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853212.854917:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552389888 00000100:00100000:2.0:1787853212.854924:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552389888 00000100:00100000:2.0:1787853212.854972:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787853212.854981:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493dc1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a76e730b-0783-4789-a5e2-a4230bb4bd66+11:14311:x1874699552389888:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787853212.855006:0:14323:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853212.855021:0:14323:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f49415b8400/0x710df789068e7270 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x710df789068e7269 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853212.855044:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f49415b8400/0x710df789068e7270 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x710df789068e7269 expref: 12 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853212.855055:0:14323:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f49415b8400/0x710df789068e7270 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x710df789068e7269 expref: 12 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853212.855065:0:14323:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49415b8400, rc 0) 00000100:00100000:2.0:1787853212.855123:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493dc1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a76e730b-0783-4789-a5e2-a4230bb4bd66+12:14311:x1874699552389888:12345-0@lo:101:mount.lustre.0 Request processed in 143us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853212.855130:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787853212.855245:0:14311:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f4902af1300 going to sleep for 11 seconds 00000100:00100000:1.0:1787853212.855266:0:14311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4803e670c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a76e730b-0783-4789-a5e2-a4230bb4bd66:14311:1874699552389888:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787853212.855281:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: ffff8f492a8ac000/0x710df789068e7269 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e7270 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853212.855289:0:14311:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: ffff8f492a8ac000/0x710df789068e7269 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x710df789068e7270 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853212.855410:0:14311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4803e670c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a76e730b-0783-4789-a5e2-a4230bb4bd66:14311:1874699552390016:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787853212.855436:0:14311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853212.855497:0:14311:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f4902af1300 going to sleep for 11 seconds 00000100:00100000:2.0:1787853212.865617:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552390016 00000100:00100000:2.0:1787853212.865633:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552390016 00000100:00100000:2.0:1787853212.865710:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787853212.865719:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493dc1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a76e730b-0783-4789-a5e2-a4230bb4bd66+12:14311:x1874699552390016:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787853212.866032:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493dc1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a76e730b-0783-4789-a5e2-a4230bb4bd66+12:14311:x1874699552390016:12345-0@lo:501:mount.lustre.0 Request processed in 313us (10594us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853212.866040:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787853212.866493:0:14311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4803e670c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a76e730b-0783-4789-a5e2-a4230bb4bd66:14311:1874699552390016:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787853212.866546:0:14311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4803e670c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a76e730b-0783-4789-a5e2-a4230bb4bd66:14311:1874699552390144:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787853212.866616:0:14311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853212.866648:0:14311:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f4902af1300 going to sleep for 11 seconds 00000100:00100000:2.0:1787853212.870529:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552390144 00000100:00100000:2.0:1787853212.870546:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552390144 00000100:00100000:2.0:1787853212.870611:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787853212.870620:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493dc1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a76e730b-0783-4789-a5e2-a4230bb4bd66+12:14311:x1874699552390144:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787853212.870895:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493dc1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a76e730b-0783-4789-a5e2-a4230bb4bd66+12:14311:x1874699552390144:12345-0@lo:503:mount.lustre.0 Request processed in 276us (4278us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853212.870911:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787853212.872554:0:14311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4803e670c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a76e730b-0783-4789-a5e2-a4230bb4bd66:14311:1874699552390144:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787853212.876250:0:14359:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f492eb892c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a76e730b-0783-4789-a5e2-a4230bb4bd66:14359:1874699552390272:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787853212.876330:0:14359:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853212.876372:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552390272 00000100:00100000:2.0:1787853212.876379:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552390272 00000100:00100000:2.0:1787853212.876418:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787853212.876428:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493dc1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a76e730b-0783-4789-a5e2-a4230bb4bd66+12:14359:x1874699552390272:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787853212.876698:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493dc1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a76e730b-0783-4789-a5e2-a4230bb4bd66+12:14359:x1874699552390272:12345-0@lo:502:llog_process_th.0 Request processed in 271us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853212.876707:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787853212.876756:0:14359:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f493c154000 going to sleep for 11 seconds 00000100:00100000:2.0:1787853212.876776:0:14359:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f492eb892c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a76e730b-0783-4789-a5e2-a4230bb4bd66:14359:1874699552390272:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1787853212.876840:0:14359:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1787853212.876856:0:14359:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8f493ffe33a0) 00000020:00000080:2.0:1787853212.876874:0:14359:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:2.0:1787853212.876948:0:14359:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f493c6e5000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787853212.876952:0:14359:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f493c6e5000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787853212.876955:0:14359:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f493c6e5000 4 00010000:00080000:2.0:1787853212.876983:0:14359:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f493410c000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.101@tcp at head 00010000:00010000:2.0:1787853212.885940:0:14359:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:2.0:1787853212.886221:0:14359:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1787853212.886259:0:14359:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787853212.886273:0:14359:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x710df789068e727e 00000100:00080000:2.0:1787853212.886284:0:14359:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787853212.886290:0:14359:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8f493410c000 using connection 192.168.204.101@tcp/0@lo 00000100:00100000:2.0:1787853212.886327:0:14359:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f492eb892c0 x1874699552390400/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787853212.886363:0:14359:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787853212.887557:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f492eb892c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874699552390400:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787853212.887653:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853212.891909:0:14359:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f492eb88000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a76e730b-0783-4789-a5e2-a4230bb4bd66:14359:1874699552390528:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787853212.891989:0:14359:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853212.892030:0:14359:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f4907a48000 going to sleep for 11 seconds 00000100:00100000:3.0:1787853212.892515:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552390400 00000100:00100000:3.0:1787853212.892524:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552390400 00000100:00100000:3.0:1787853212.892586:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787853212.892594:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49092bc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3305:x1874699552390400:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787853212.893855:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49092bc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3305:x1874699552390400:12345-0@lo:38:llog_process_th.0 Request processed in 1255us (6197us total) trans 0 rc -11/-11 00000100:00100000:3.0:1787853212.893867:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787853212.893938:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787853212.893946:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8f493410c000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787853212.893950:0:3305:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1787853212.893961:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f492eb892c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874699552390400:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787853212.893991:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552390528 00000100:00100000:3.0:1787853212.893996:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552390528 00000100:00100000:3.0:1787853212.894033:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787853212.894040:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493dc1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a76e730b-0783-4789-a5e2-a4230bb4bd66+12:14359:x1874699552390528:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787853212.894317:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493dc1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a76e730b-0783-4789-a5e2-a4230bb4bd66+12:14359:x1874699552390528:12345-0@lo:502:llog_process_th.0 Request processed in 277us (2328us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853212.894324:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787853212.894384:0:14359:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f492eb88000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a76e730b-0783-4789-a5e2-a4230bb4bd66:14359:1874699552390528:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1787853212.894410:0:14359:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1787853212.894914:0:14311:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1787853212.894936:0:14311:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787853212.894961:0:14311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f492a8ac000/0x710df789068e7269 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e7270 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853212.894972:0:14311:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: ffff8f492a8ac000/0x710df789068e7269 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e7270 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787853212.895019:0:14311:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787853212.895021:0:14311:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787853212.895022:0:14311:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787853212.895023:0:14311:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787853212.895025:0:14311:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787853212.895026:0:14311:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787853212.895028:0:14311:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787853212.895030:0:14311:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787853212.895244:0:14311:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787853212.895246:0:14311:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787853212.895250:0:14311:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1787853212.895253:0:14311:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787853212.895260:0:14311:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787853212.895261:0:14311:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787853212.895262:0:14311:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787853212.895263:0:14311:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787853212.895265:0:14311:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787853212.895266:0:14311:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787853212.895267:0:14311:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787853212.895268:0:14311:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787853212.895270:0:14311:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787853212.895291:0:14311:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1787853212.895306:0:14311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4803e670c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a76e730b-0783-4789-a5e2-a4230bb4bd66:14311:1874699552390656:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787853212.895354:0:14311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853212.895391:0:14311:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f4902af1180 going to sleep for 11 seconds 00000100:00100000:2.0:1787853212.895609:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552390656 00000100:00100000:2.0:1787853212.895616:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552390656 00000100:00100000:2.0:1787853212.895650:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787853212.895658:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493dc1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a76e730b-0783-4789-a5e2-a4230bb4bd66+12:14311:x1874699552390656:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787853212.895692:0:14323:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1787853212.895705:0:14323:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1787853212.934235:0:14323:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787853212.934255:0:14323:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1787853212.934302:0:14345:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787853212.934307:0:14345:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787853212.934339:0:14345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f49415b6e00/0x710df789068e7285 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853212.934360:0:14345:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f492a8ace00/0x710df789068e7254 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x710df789068e724d expref: 12 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853212.934390:0:14345:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f49415b6e00/0x710df789068e7285 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853212.934444:0:14345:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f492a8ace00/0x710df789068e7254 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x710df789068e724d expref: 12 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853212.934459:0:14345:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f492a8ace00/0x710df789068e7254 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x710df789068e724d expref: 12 pid: 14323 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853212.934475:0:14345:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49092bfc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14345:1874699552390784:0@lo:104: 00000100:00100000:0.0:1787853212.934539:0:14345:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853212.934603:0:14345:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f48013ca6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787853212.934701:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552390784 00000100:00100000:2.0:1787853212.934708:0:14312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552390784 00000100:00100000:2.0:1787853212.934742:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787853212.934760:0:14312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49092bf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a76e730b-0783-4789-a5e2-a4230bb4bd66+3:14345:x1874699552390784:12345-0@lo:104: 00010000:00010000:2.0:1787853212.934781:0:14312:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.101@tcp lock: ffff8f49415b7400/0x710df789068e724d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x710df789068e7254 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853212.934845:0:14312:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787853212.934852:0:14312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49092bf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a76e730b-0783-4789-a5e2-a4230bb4bd66+3:14345:x1874699552390784:12345-0@lo:104: Request processed in 94us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853212.934859:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1787853212.934894:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787853212.934901:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.101@tcp lock: ffff8f49415b7400/0x710df789068e724d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x710df789068e7254 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853212.934921:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b7400 already unused, calling callback (ffffffffc1b55c20) 10000000:00010000:2.0:1787853212.934926:0:14318:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.101@tcp lock: ffff8f49415b7400/0x710df789068e724d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x710df789068e7254 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853212.934935:0:14318:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.101@tcp lock: ffff8f49415b7400/0x710df789068e724d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x710df789068e7254 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787853212.934941:0:14318:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.101@tcp lock: ffff8f49415b7400/0x710df789068e724d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x710df789068e7254 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787853212.934947:0:14318:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787853212.934977:0:14318:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.101@tcp lock: ffff8f49415b7400/0x710df789068e724d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x710df789068e7254 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853212.934984:0:14318:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787853212.935003:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.101@tcp lock: ffff8f49415b7400/0x710df789068e724d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x710df789068e7254 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853212.935011:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.101@tcp lock: ffff8f49415b7400/0x710df789068e724d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x710df789068e7254 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853212.935029:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853212.935031:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853212.935033:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787853212.935107:0:14345:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49092bfc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14345:1874699552390784:0@lo:104: 00010000:00010000:0.0:1787853212.935125:0:14345:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f49415b6e00/0x710df789068e7285 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853212.935623:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f492eb8b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a76e730b-0783-4789-a5e2-a4230bb4bd66:3306:1874699552390912:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787853212.935663:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853212.935876:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552390912 00000100:00100000:0.0:1787853212.935883:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552390912 00010000:00010000:0.0:1787853212.935909:0:14314:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f492a8ace00/0x710df789068e7254 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x710df789068e724d expref: 13 pid: 14323 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853212.935940:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787853212.935948:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4934116580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a76e730b-0783-4789-a5e2-a4230bb4bd66+13:3306:x1874699552390912:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787853212.935959:0:14314:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787853212.935964:0:14314:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f492a8ace00/0x710df789068e7254 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x710df789068e724d expref: 13 pid: 14323 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853212.935976:0:14314:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f492a8ace00/0x710df789068e7254 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x710df789068e724d expref: 13 pid: 14323 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853212.935998:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f492a8ace00/0x710df789068e7254 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x710df789068e724d expref: 13 pid: 14323 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853212.936012:0:14314:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f49415b6e00/0x710df789068e7285 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853212.936021:0:14314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f49415b6e00/0x710df789068e7285 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787853212.936036:0:14314:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001729752s 00010000:00010000:0.0:1787853212.936040:0:14314:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f49415b6e00/0x710df789068e7285 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853212.936048:0:14314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f49415b6e00/0x710df789068e7285 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853212.936055:0:14314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f49415b6e00/0x710df789068e7285 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853212.936062:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f49415b6e00/0x710df789068e7285 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853212.936068:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b6e00 already unused, calling callback (ffffffffc1528440) 00010000:00010000:0.0:1787853212.936071:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f49415b6e00/0x710df789068e7285 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853212.936089:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f49415b6e00/0x710df789068e7285 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853212.936106:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f49415b6e00/0x710df789068e7285 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853212.936122:0:14314:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787853212.936170:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4934116580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a76e730b-0783-4789-a5e2-a4230bb4bd66+12:3306:x1874699552390912:12345-0@lo:103:ldlm_bl.0 Request processed in 223us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853212.936177:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1787853212.936199:0:14345:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f49415b6e00/0x710df789068e7285 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853212.936207:0:14345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f49415b6e00/0x710df789068e7285 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853212.936213:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f49415b6e00/0x710df789068e7285 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853212.936246:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f492eb8b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a76e730b-0783-4789-a5e2-a4230bb4bd66:3306:1874699552390912:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787853212.950134:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493dc1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a76e730b-0783-4789-a5e2-a4230bb4bd66+11:14311:x1874699552390656:12345-0@lo:253:mount.lustre.0 Request processed in 54468us (54772us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853212.950159:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787853212.950327:0:14311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4803e670c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a76e730b-0783-4789-a5e2-a4230bb4bd66:14311:1874699552390656:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787853212.950345:0:14311:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1787853212.950349:0:14311:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787853212.950351:0:14311:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787853212.950352:0:14311:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787853212.950353:0:14311:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787853212.950354:0:14311:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787853212.950356:0:14311:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787853212.950357:0:14311:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787853212.950359:0:14311:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787853212.950361:0:14311:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787853212.950362:0:14311:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787853212.950377:0:14311:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1787853212.955545:0:14311:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1787853212.955790:0:14311:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1787853212.956095:0:14311:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1787853212.956266:0:14311:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1787853212.956547:0:14311:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1787853212.956769:0:14311:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1787853212.960177:0:14311:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1787853212.960355:0:14311:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1787853212.960645:0:14311:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1787853212.960949:0:14311:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1787853212.961277:0:14311:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1787853212.961435:0:14311:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:0.0:1787853212.985201:0:14311:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:0.0:1787853212.985531:0:14311:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:1.0:1787853212.986049:0:14369:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:1.0:1787853212.986122:0:14369:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:3.0:1787853212.987411:0:14368:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:3.0:1787853212.987419:0:14368:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:00080000:1.0:1787853212.988435:0:14369:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1787853212.988505:0:14369:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1787853212.988510:0:14369:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:0.0:1787853212.989721:0:14311:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1787853212.989989:0:14311:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1787853212.990362:0:14311:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1787853212.990368:0:14311:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1787853212.990466:0:14311:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787853212.991357:0:14311:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1787853212.991952:0:14311:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1787853212.991978:0:14311:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:1.0:1787853212.993384:0:14311:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:2.0:1787853213.001531:0:14311:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:2.0:1787853213.023319:0:14311:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1787853213.023390:0:14311:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffff9a7d00d17988 00100000:10000000:2.0:1787853213.023399:0:14311:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1787853213.024265:0:14311:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787853213.024282:0:14311:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.101@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787853213.024298:0:14311:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1787853213.024322:0:14311:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:0.0:1787853213.418800:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787853213.611752:0:14326:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787853213.611761:0:14326:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8f493c6e5000 from 6 10000000:01000000:2.0:1787853213.611766:0:14326:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787853213.611815:0:14326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f49415b8e00/0x710df789068e728c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853213.611831:0:14326:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.101@tcp lock: ffff8f49415b8e00/0x710df789068e728c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853213.611847:0:14326:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: ffff8f49415b8e00/0x710df789068e728c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853213.611873:0:14326:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f492eb88780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a76e730b-0783-4789-a5e2-a4230bb4bd66:14326:1874699552391040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787853213.611948:0:14326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853213.612020:0:14326:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f493480dd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787853213.612695:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552391040 00000100:00100000:0.0:1787853213.612705:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552391040 00000100:00100000:0.0:1787853213.612799:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787853213.612808:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493dc1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a76e730b-0783-4789-a5e2-a4230bb4bd66+11:14326:x1874699552391040:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787853213.612823:0:14324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853213.612839:0:14324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f49415b6e00/0x710df789068e7293 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x710df789068e728c expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853213.612875:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f49415b6e00/0x710df789068e7293 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x710df789068e728c expref: 12 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853213.612886:0:14324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f49415b6e00/0x710df789068e7293 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x710df789068e728c expref: 12 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853213.612896:0:14324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49415b6e00, rc 0) 00000100:00100000:0.0:1787853213.612951:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493dc1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a76e730b-0783-4789-a5e2-a4230bb4bd66+12:14326:x1874699552391040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 144us (1005us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853213.612958:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787853213.623162:0:14326:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f492eb88780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a76e730b-0783-4789-a5e2-a4230bb4bd66:14326:1874699552391040:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787853213.623206:0:14326:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: ffff8f49415b8e00/0x710df789068e728c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e7293 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853213.623227:0:14326:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: ffff8f49415b8e00/0x710df789068e728c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x710df789068e7293 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853213.623322:0:14326:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f492eb88780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a76e730b-0783-4789-a5e2-a4230bb4bd66:14326:1874699552391168:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787853213.625054:0:14326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853213.625098:0:14326:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f493480dd80 going to sleep for 11 seconds 00000100:00100000:2.0:1787853213.625121:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552391168 00000100:00100000:2.0:1787853213.625203:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552391168 00000100:00100000:2.0:1787853213.625655:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787853213.625667:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f491040e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a76e730b-0783-4789-a5e2-a4230bb4bd66+12:14326:x1874699552391168:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787853213.625692:0:14323:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787853213.625723:0:14323:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787853213.625727:0:14323:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1787853213.625824:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f491040e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a76e730b-0783-4789-a5e2-a4230bb4bd66+12:14326:x1874699552391168:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 160us (775us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853213.625832:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787853213.625881:0:14326:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f492eb88780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a76e730b-0783-4789-a5e2-a4230bb4bd66:14326:1874699552391168:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787853213.625925:0:14326:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787853213.625934:0:14326:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f49415b8e00/0x710df789068e728c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e7293 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853213.625945:0:14326:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: ffff8f49415b8e00/0x710df789068e728c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e7293 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787853213.933526:0:14361:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787853214.441756:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787853214.959857:0:14361:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787853215.466413:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853216.496982:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853217.517223:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787853217.655953:0:14612:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg401-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:3.0:1787853218.028913:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787853218.028920:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787853218.028923:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787853218.028926:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787853218.028929:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1787853218.028932:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787853218.028936:0:36:0:(import.c:65:import_set_state_nolock()) ffff8f493410c000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787853218.028948:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8f493410c000 using connection 192.168.204.101@tcp/0@lo 00000100:00100000:3.0:1787853218.028970:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f4934115a40 x1874699552391424/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787853218.029008:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787853218.029021:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4934117840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a76e730b-0783-4789-a5e2-a4230bb4bd66:3306:1874699552391296:0@lo:400:kworker.0 00000100:00100000:3.0:1787853218.029279:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853218.029392:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552391296 00000100:00100000:1.0:1787853218.029400:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552391296 00000100:00100000:1.0:1787853218.029451:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787853218.029461:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f491040dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a76e730b-0783-4789-a5e2-a4230bb4bd66+12:3306:x1874699552391296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853218.029514:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f491040dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a76e730b-0783-4789-a5e2-a4230bb4bd66+12:3306:x1874699552391296:12345-0@lo:400:kworker.0 Request processed in 54us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853218.029521:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787853218.029566:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4934115a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874699552391424:0@lo:38:kworker.0 00000100:00100000:1.0:1787853218.029629:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853218.029675:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4934117840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a76e730b-0783-4789-a5e2-a4230bb4bd66:3306:1874699552391296:0@lo:400:kworker.0 00000100:00100000:2.0:1787853218.031377:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552391424 00000100:00100000:2.0:1787853218.031394:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552391424 00000100:00100000:2.0:1787853218.031444:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787853218.031454:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4803e66940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3305:x1874699552391424:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1787853218.031499:0:14331:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 537 last 0 00000020:00000080:2.0:1787853218.031544:0:14331:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x710df789068e729a 00000004:00100000:2.0:1787853218.031562:0:14331:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787853218.031989:0:14331:0:(import.c:65:import_set_state_nolock()) ffff8f4908b1f800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787853218.032368:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4803e66940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874699552391424:12345-0@lo:38:kworker.0 Request processed in 912us (2734us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853218.032379:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787853218.033766:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8f4934115a40 x1874699552391424/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787853228 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787853218.033789:0:3305:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1787853218.033797:0:3305:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1787853218.033803:0:3305:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787853218.033806:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8f493410c000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787853218.033814:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4934115a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874699552391424:0@lo:38:kworker.0 00010000:00010000:0.0:1787853218.542444:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853219.564378:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853220.586814:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853221.609846:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787853222.125761:0:3305:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787853212/real 1787853212] req@ffff8f492eb8a580 x1874699552388736/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787853222 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787853222.125810:0:3305:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8f492eb8a580 x1874699552388736/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787853222 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787853222.125822:0:3305:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787853212/real 1787853212] req@ffff8f49341170c0 x1874699552388608/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787853222 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787853222.125845:0:3305:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8f49341170c0 x1874699552388608/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787853222 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787853222.125867:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8f4911cd3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787853222.125881:0:3305:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787853222.125886:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f492eb8a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1874699552388736:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1787853222.125892:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8f4908b0a000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787853222.125899:0:3305:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787853222.125902:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49341170c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1874699552388608:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1787853222.128248:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787853222.128256:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1787853222.128261:0:36:0:(import.c:65:import_set_state_nolock()) ffff8f4908b0a000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787853222.128270:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 532 00000100:00080000:1.0:1787853222.128277:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787853222.128285:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8f4908b0a000 using connection 192.168.204.101@tcp/0@lo 00000100:00100000:1.0:1787853222.128310:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f4803e65a40 x1874699552391680/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787853222.128331:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787853222.128334:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787853222.128336:0:36:0:(import.c:65:import_set_state_nolock()) ffff8f4911cd3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787853222.128340:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 532 00000100:00080000:1.0:1787853222.128343:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787853222.128346:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8f4911cd3800 using connection 192.168.204.101@tcp/0@lo 00000100:00100000:1.0:1787853222.128356:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f4803e64b40 x1874699552391808/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787853222.128423:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4803e64f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a76e730b-0783-4789-a5e2-a4230bb4bd66:3308:1874699552391552:0@lo:400:kworker.0 00000100:00100000:1.0:1787853222.128518:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853222.128685:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787853222.128693:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4803e67840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874699552391936:0@lo:400:kworker.0 00000100:00100000:2.0:1787853222.128698:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552391552 00000100:00100000:2.0:1787853222.128709:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552391552 00000100:00100000:1.0:1787853222.128726:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853222.128769:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787853222.128782:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f491040e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a76e730b-0783-4789-a5e2-a4230bb4bd66+12:3308:x1874699552391552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853222.128815:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552391936 00000100:00100000:1.0:1787853222.128820:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552391936 00000100:00100000:1.0:1787853222.128855:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787853222.128863:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4803e643c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874699552391936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853222.128874:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f491040e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a76e730b-0783-4789-a5e2-a4230bb4bd66+12:3308:x1874699552391552:12345-0@lo:400:kworker.0 Request processed in 93us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853222.128883:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787853222.128911:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4803e643c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874699552391936:12345-0@lo:400:kworker.0 Request processed in 48us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853222.128921:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787853222.128956:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8f4803e67840 x1874699552391936/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787853238 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787853222.128982:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4803e67840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874699552391936:0@lo:400:kworker.0 00000100:00100000:2.0:1787853222.128994:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4803e64f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a76e730b-0783-4789-a5e2-a4230bb4bd66:3308:1874699552391552:0@lo:400:kworker.0 00000100:00100000:2.0:1787853222.130636:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4803e65a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1874699552391680:0@lo:8:kworker.0 00000400:00000100:2.0:1787853222.130811:0:3305:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874699552391680 offset 0 length 520: 4 00000100:00100000:2.0:1787853222.130869:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4803e64b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1874699552391808:0@lo:8:kworker.0 00000400:00000100:2.0:1787853222.130896:0:3305:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874699552391808 offset 0 length 520: 4 00000020:00000080:0.0:1787853222.286212:0:14763:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc64aef960 20000000:00000080:0.0:1787853222.286235:0:14763:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8f493578e800 uarg=0000000000000000 20000000:01000000:0.0:1787853222.286281:0:14763:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1787853222.286290:0:14763:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1787853222.286296:0:14763:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1787853222.289460:0:14764:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:1.0:1787853222.289794:0:14763:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1787853222.298545:0:14763:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787853222.300073:0:14763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f49415b7200/0x710df789068e72a1 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853222.300120:0:14763:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f492a8acc00/0x710df789068e7262 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x710df789068e725b expref: 11 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853222.300130:0:14763:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f49415b7200/0x710df789068e72a1 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853222.300192:0:14763:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f492a8acc00/0x710df789068e7262 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x710df789068e725b expref: 11 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853222.300212:0:14763:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f492a8acc00/0x710df789068e7262 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x710df789068e725b expref: 11 pid: 14323 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853222.300230:0:14763:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49092bed00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14763:1874699552392064:0@lo:104: 00000100:00100000:0.0:1787853222.300329:0:14763:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853222.300411:0:14763:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f494160acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787853222.300677:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552392064 00000100:00100000:2.0:1787853222.300688:0:14313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552392064 00000100:00100000:2.0:1787853222.300765:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787853222.300777:0:14313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49092be580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a76e730b-0783-4789-a5e2-a4230bb4bd66+3:14763:x1874699552392064:12345-0@lo:104: 00010000:00010000:2.0:1787853222.300805:0:14313:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.101@tcp lock: ffff8f49415b7800/0x710df789068e725b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x710df789068e7262 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853222.300911:0:14313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787853222.300919:0:14313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49092be580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a76e730b-0783-4789-a5e2-a4230bb4bd66+3:14763:x1874699552392064:12345-0@lo:104: Request processed in 144us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853222.300928:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1787853222.300975:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1787853222.300979:0:14763:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49092bed00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14763:1874699552392064:0@lo:104: 00010000:00010000:2.0:1787853222.300985:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.101@tcp lock: ffff8f49415b7800/0x710df789068e725b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x710df789068e7262 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853222.301003:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b7800 already unused, calling callback (ffffffffc1b55c20) 10000000:00010000:2.0:1787853222.301010:0:14318:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.101@tcp lock: ffff8f49415b7800/0x710df789068e725b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x710df789068e7262 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853222.301020:0:14318:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.101@tcp lock: ffff8f49415b7800/0x710df789068e725b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x710df789068e7262 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853222.301030:0:14763:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f49415b7200/0x710df789068e72a1 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787853222.301031:0:14318:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.101@tcp lock: ffff8f49415b7800/0x710df789068e725b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x710df789068e7262 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787853222.301062:0:14318:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787853222.301109:0:14318:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.101@tcp lock: ffff8f49415b7800/0x710df789068e725b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x710df789068e7262 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853222.301116:0:14318:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787853222.301146:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.101@tcp lock: ffff8f49415b7800/0x710df789068e725b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x710df789068e7262 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853222.301154:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.101@tcp lock: ffff8f49415b7800/0x710df789068e725b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x710df789068e7262 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853222.301185:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853222.301187:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853222.301189:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787853222.301209:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787853222.301222:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f492eb8a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a76e730b-0783-4789-a5e2-a4230bb4bd66:3307:1874699552392192:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787853222.301260:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853222.301316:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552392192 00000100:00100000:1.0:1787853222.301324:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552392192 00010000:00010000:1.0:1787853222.301367:0:14314:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f492a8acc00/0x710df789068e7262 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x710df789068e725b expref: 12 pid: 14323 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853222.301412:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787853222.301421:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f492eb8b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a76e730b-0783-4789-a5e2-a4230bb4bd66+12:3307:x1874699552392192:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787853222.301437:0:14314:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787853222.301442:0:14314:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f492a8acc00/0x710df789068e7262 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x710df789068e725b expref: 12 pid: 14323 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853222.301454:0:14314:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f492a8acc00/0x710df789068e7262 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x710df789068e725b expref: 12 pid: 14323 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853222.301471:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f492a8acc00/0x710df789068e7262 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x710df789068e725b expref: 12 pid: 14323 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853222.301488:0:14314:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f49415b7200/0x710df789068e72a1 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853222.301519:0:14314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f49415b7200/0x710df789068e72a1 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853222.301534:0:14314:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f49415b7200/0x710df789068e72a1 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853222.301541:0:14314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f49415b7200/0x710df789068e72a1 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853222.301547:0:14314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f49415b7200/0x710df789068e72a1 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853222.301554:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f49415b7200/0x710df789068e72a1 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853222.301561:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b7200 already unused, calling callback (ffffffffc1528440) 00010000:00010000:1.0:1787853222.301869:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f49415b7200/0x710df789068e72a1 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853222.301880:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f49415b7200/0x710df789068e72a1 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853222.301902:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f49415b7200/0x710df789068e72a1 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853222.301911:0:14314:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787853222.301936:0:14763:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f49415b7200/0x710df789068e72a1 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853222.301969:0:14763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f49415b7200/0x710df789068e72a1 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853222.301977:0:14763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f49415b7200/0x710df789068e72a1 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853222.302016:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f492eb8b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a76e730b-0783-4789-a5e2-a4230bb4bd66+11:3307:x1874699552392192:12345-0@lo:103:ldlm_bl.0 Request processed in 593us (752us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853222.302028:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787853222.302296:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f492eb8a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a76e730b-0783-4789-a5e2-a4230bb4bd66:3307:1874699552392192:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787853222.633873:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787853223.401704:0:14326:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787853223.401713:0:14326:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f493c6e5000 from 10 10000000:01000000:2.0:1787853223.401719:0:14326:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787853223.401767:0:14326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f49415b9800/0x710df789068e72a8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853223.401779:0:14326:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.101@tcp lock: ffff8f49415b9800/0x710df789068e72a8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853223.401791:0:14326:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: ffff8f49415b9800/0x710df789068e72a8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853223.401817:0:14326:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f492eb88000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a76e730b-0783-4789-a5e2-a4230bb4bd66:14326:1874699552392320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787853223.401888:0:14326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853223.401952:0:14326:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f49065f7540 going to sleep for 11 seconds 00000100:00100000:3.0:1787853223.402276:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552392320 00000100:00100000:3.0:1787853223.402284:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552392320 00000100:00100000:3.0:1787853223.402348:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787853223.402358:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f491040c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a76e730b-0783-4789-a5e2-a4230bb4bd66+11:14326:x1874699552392320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787853223.402385:0:14323:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853223.402401:0:14323:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f4921e21c00/0x710df789068e72af lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x710df789068e72a8 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853223.402425:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f4921e21c00/0x710df789068e72af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x710df789068e72a8 expref: 12 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853223.402435:0:14323:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f4921e21c00/0x710df789068e72af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x710df789068e72a8 expref: 12 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853223.402445:0:14323:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4921e21c00, rc 0) 00000100:00100000:3.0:1787853223.402491:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f491040c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a76e730b-0783-4789-a5e2-a4230bb4bd66+12:14326:x1874699552392320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853223.402498:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787853223.402557:0:14326:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f492eb88000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a76e730b-0783-4789-a5e2-a4230bb4bd66:14326:1874699552392320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787853223.402590:0:14326:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: ffff8f49415b9800/0x710df789068e72a8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e72af expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853223.402599:0:14326:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: ffff8f49415b9800/0x710df789068e72a8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x710df789068e72af expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853223.403008:0:14326:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49341170c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a76e730b-0783-4789-a5e2-a4230bb4bd66:14326:1874699552392448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787853223.403039:0:14326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853223.403065:0:14326:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f4911ecd780 going to sleep for 11 seconds 00000100:00100000:0.0:1787853223.403327:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552392448 00000100:00100000:0.0:1787853223.403333:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552392448 00000100:00100000:0.0:1787853223.403368:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787853223.403376:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f491040f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a76e730b-0783-4789-a5e2-a4230bb4bd66+12:14326:x1874699552392448:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787853223.404918:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f491040f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a76e730b-0783-4789-a5e2-a4230bb4bd66+12:14326:x1874699552392448:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1538us (1873us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853223.404950:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787853223.408263:0:14326:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49341170c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a76e730b-0783-4789-a5e2-a4230bb4bd66:14326:1874699552392448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787853223.408337:0:14326:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49341170c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a76e730b-0783-4789-a5e2-a4230bb4bd66:14326:1874699552392576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787853223.408424:0:14326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853223.408469:0:14326:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f4911ecd780 going to sleep for 11 seconds 00000100:00100000:2.0:1787853223.408529:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552392576 00000100:00100000:2.0:1787853223.408535:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552392576 00000100:00100000:2.0:1787853223.408614:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787853223.408623:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f491040c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a76e730b-0783-4789-a5e2-a4230bb4bd66+12:14326:x1874699552392576:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787853223.408840:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f491040c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a76e730b-0783-4789-a5e2-a4230bb4bd66+12:14326:x1874699552392576:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 218us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853223.408857:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787853223.410119:0:14326:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49341170c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a76e730b-0783-4789-a5e2-a4230bb4bd66:14326:1874699552392576:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787853223.413218:0:14797:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1787853223.413825:0:14326:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1787853223.413849:0:14326:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787853223.413860:0:14326:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f49415b9800/0x710df789068e72a8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e72af expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853223.413871:0:14326:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: ffff8f49415b9800/0x710df789068e72a8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e72af expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853223.671999:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787853224.170282:0:14361:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787853224.681851:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787853225.708696:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853226.730718:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787853227.241751:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787853227.241760:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787853227.241763:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787853227.241766:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787853227.241792:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787853227.241804:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787853227.241815:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4803e64780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a76e730b-0783-4789-a5e2-a4230bb4bd66:3306:1874699552392704:0@lo:400:kworker.0 00000100:00100000:1.0:1787853227.241817:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4803e66d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874699552392832:0@lo:400:kworker.0 00000100:00100000:1.0:1787853227.242046:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853227.242050:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853227.242173:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552392704 00000100:00100000:0.0:1787853227.242191:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552392704 00000100:00100000:0.0:1787853227.242245:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787853227.242255:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f491040d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a76e730b-0783-4789-a5e2-a4230bb4bd66+12:3306:x1874699552392704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853227.243208:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552392832 00000100:00100000:3.0:1787853227.243217:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552392832 00000100:00100000:3.0:1787853227.243267:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787853227.243275:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4803e661c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874699552392832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853227.246563:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f491040d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a76e730b-0783-4789-a5e2-a4230bb4bd66+12:3306:x1874699552392704:12345-0@lo:400:kworker.0 Request processed in 4299us (4505us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853227.246593:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787853227.246752:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4803e64780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a76e730b-0783-4789-a5e2-a4230bb4bd66:3306:1874699552392704:0@lo:400:kworker.0 00000100:00100000:2.0:1787853227.254108:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4803e661c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874699552392832:12345-0@lo:400:kworker.0 Request processed in 10822us (12053us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853227.254124:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787853227.254800:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8f4803e66d00 x1874699552392832/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787853243 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787853227.254816:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4803e66d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874699552392832:0@lo:400:kworker.0 00010000:00010000:3.0:1787853227.753749:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787853227.791332:0:15012:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787853227.791338:0:15012:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:1.0:1787853227.791460:0:15012:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8f493483e000 00000020:01000004:1.0:1787853227.791477:0:15012:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1787853227.791488:0:15012:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1787853227.791503:0:15012:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8f493d11cd70) 00000020:00000080:1.0:1787853227.791521:0:15012:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1787853227.810275:0:15012:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1787853227.810991:0:15012:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1787853227.812378:0:15012:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1787853227.812973:0:15012:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:1.0:1787853227.813272:0:15012:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:1.0:1787853227.814232:0:15012:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 441: rc = 0 00100000:10000000:1.0:1787853227.815696:0:15012:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 441: rc = 0 00100000:10000000:1.0:1787853227.816020:0:15012:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 441: rc = 0 00100000:10000000:1.0:1787853227.820357:0:15012:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 645: rc = 0 00100000:10000000:1.0:1787853227.821368:0:15012:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 645: rc = 0 00100000:10000000:1.0:1787853227.822090:0:15012:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 645: rc = 0 00100000:10000000:1.0:1787853227.823110:0:15012:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 645: rc = 0 00100000:10000000:1.0:1787853227.823552:0:15012:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 645: rc = 0 00100000:10000000:1.0:1787853227.824128:0:15012:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 645: rc = 0 00000020:00000080:1.0:1787853227.829155:0:15012:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1787853227.829168:0:15012:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787853227.829180:0:15012:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x710df789068e72bd 00000020:01000004:1.0:1787853227.829189:0:15012:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:1.0:1787853227.829211:0:15012:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.101@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1787853227.829214:0:15012:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.101@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1787853227.829220:0:15012:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1787853227.829225:0:15012:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1787853227.829236:0:15012:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8f493d1199d0) 00000020:00000080:1.0:1787853227.829247:0:15012:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:1.0:1787853227.830418:0:15012:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787853227.830640:0:15012:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1787853227.830647:0:15012:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1787853227.839741:0:15012:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1787853227.839757:0:15012:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1787853227.841725:0:15012:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1787853227.841740:0:15012:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1787853227.847493:0:15012:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787853227.848094:0:15012:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1787853227.848101:0:15012:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1787853227.849364:0:15012:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1787853227.849375:0:15012:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1787853227.877238:0:15012:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787853227.877486:0:15012:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1787853227.877495:0:15012:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1787853227.880410:0:15012:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1787853227.880425:0:15012:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1787853227.882470:0:15012:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1787853227.882484:0:15012:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1787853227.887375:0:15012:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787853227.888266:0:15012:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1787853227.888274:0:15012:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1787853227.890304:0:15012:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1787853227.890318:0:15012:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1787853227.939525:0:15012:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787853227.940027:0:15012:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1787853227.940038:0:15012:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1787853227.942242:0:15012:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1787853227.942258:0:15012:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1787853227.943700:0:15012:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1787853227.943745:0:15012:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1787853227.943752:0:15012:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.101@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1787853227.976377:0:15012:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.101@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787853227.976428:0:15012:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.101@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1787853227.976433:0:15012:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787853227.976435:0:15012:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787853227.976436:0:15012:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787853227.976438:0:15012:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787853227.976443:0:15012:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787853227.976444:0:15012:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787853227.976446:0:15012:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787853227.976448:0:15012:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787853227.976449:0:15012:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787853227.976453:0:15012:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1787853227.976456:0:15012:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787853227.976457:0:15012:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787853227.976458:0:15012:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787853227.976459:0:15012:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787853227.976460:0:15012:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787853227.976461:0:15012:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787853227.976462:0:15012:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787853227.976463:0:15012:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787853227.976464:0:15012:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787853227.976497:0:15012:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1787853227.976521:0:15012:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49092bd680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a76e730b-0783-4789-a5e2-a4230bb4bd66:15012:1874699552392960:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787853227.981282:0:15012:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853227.981414:0:15012:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f490316b0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787853228.005483:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552392960 00000100:00100000:3.0:1787853228.005499:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552392960 00000100:00100000:3.0:1787853228.006209:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787853228.006223:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f491040f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a76e730b-0783-4789-a5e2-a4230bb4bd66+12:15012:x1874699552392960:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787853228.006258:0:14324:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1787853228.006262:0:14324:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:3.0:1787853228.006266:0:14324:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1787853228.032070:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f491040f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a76e730b-0783-4789-a5e2-a4230bb4bd66+12:15012:x1874699552392960:12345-0@lo:253:mount.lustre.0 Request processed in 25842us (50782us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853228.032083:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787853228.032946:0:15012:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49092bd680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a76e730b-0783-4789-a5e2-a4230bb4bd66:15012:1874699552392960:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787853228.032964:0:15012:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1787853228.032967:0:15012:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787853228.032969:0:15012:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787853228.032970:0:15012:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787853228.032972:0:15012:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787853228.032988:0:15012:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787853228.032989:0:15012:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787853228.032991:0:15012:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787853228.032993:0:15012:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787853228.032994:0:15012:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787853228.033017:0:15012:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8f493483e000 from lustre-OST0000 10000000:01000000:3.0:1787853228.033318:0:15012:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1787853228.033322:0:15012:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1787853228.033329:0:15012:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8f493ffe4d70 local copy 00010000:00010000:3.0:1787853228.033339:0:15012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f49415b6600/0x710df789068e71b3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e71ba expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853228.035614:0:15012:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f492eb8bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a76e730b-0783-4789-a5e2-a4230bb4bd66:15012:1874699552393088:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787853228.037478:0:15012:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853228.037538:0:15012:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f4910aa0180 going to sleep for 11 seconds 00000100:00100000:3.0:1787853228.037977:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552393088 00000100:00100000:3.0:1787853228.037986:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552393088 00000100:00100000:3.0:1787853228.038049:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787853228.038060:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f491040d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a76e730b-0783-4789-a5e2-a4230bb4bd66+12:15012:x1874699552393088:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787853228.040408:0:15012:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f492eb8bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a76e730b-0783-4789-a5e2-a4230bb4bd66:15012:1874699552393088:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1787853228.040444:0:15012:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.101@tcp: no remote llog for lustre-sptlrpc, check MGS config 00000100:00100000:0.0:1787853228.040519:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f491040d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a76e730b-0783-4789-a5e2-a4230bb4bd66+12:15012:x1874699552393088:12345-0@lo:501:mount.lustre.0 Request processed in 2256us (2839us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787853228.040532:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 10000000:01000000:2.0:1787853228.042999:0:15012:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.101@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787853228.043023:0:15012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f49415b6600/0x710df789068e71b3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e71ba expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853228.043036:0:15012:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: ffff8f49415b6600/0x710df789068e71b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e71ba expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787853228.043086:0:15012:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8f493483e000 10000000:01000000:2.0:1787853228.043091:0:15012:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787853228.043096:0:15012:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8f493ffe4d70 10000000:01000000:2.0:1787853228.043099:0:15012:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1787853228.043102:0:15012:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8f493ffe4d70 from 1 10000000:01000000:2.0:1787853228.043104:0:15012:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1787853228.048793:0:15012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f49415b7000/0x710df789068e72cb lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853228.048816:0:15012:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.101@tcp lock: ffff8f49415b7000/0x710df789068e72cb lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853228.048833:0:15012:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: ffff8f49415b7000/0x710df789068e72cb lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853228.048877:0:15012:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f492eb8b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a76e730b-0783-4789-a5e2-a4230bb4bd66:15012:1874699552393216:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787853228.048958:0:15012:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853228.049018:0:15012:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f490316b0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787853228.050736:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552393216 00000100:00100000:2.0:1787853228.050748:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552393216 00000100:00100000:2.0:1787853228.050831:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787853228.050841:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f491040c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a76e730b-0783-4789-a5e2-a4230bb4bd66+12:15012:x1874699552393216:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787853228.050869:0:14324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853228.050890:0:14324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f49415b9a00/0x710df789068e72d2 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x710df789068e72cb expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853228.050918:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f49415b9a00/0x710df789068e72d2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x710df789068e72cb expref: 13 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853228.050929:0:14324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f49415b9a00/0x710df789068e72d2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x710df789068e72cb expref: 13 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853228.050939:0:14324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49415b9a00, rc 0) 00000100:00100000:2.0:1787853228.051023:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f491040c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a76e730b-0783-4789-a5e2-a4230bb4bd66+13:15012:x1874699552393216:12345-0@lo:101:mount.lustre.0 Request processed in 184us (2065us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853228.051031:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787853228.051696:0:15012:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f492eb8b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a76e730b-0783-4789-a5e2-a4230bb4bd66:15012:1874699552393216:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787853228.051720:0:15012:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: ffff8f49415b7000/0x710df789068e72cb lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e72d2 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853228.051729:0:15012:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: ffff8f49415b7000/0x710df789068e72cb lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x710df789068e72d2 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787853228.051753:0:15012:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.101@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1787853228.051777:0:15012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f49415b7000/0x710df789068e72cb lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e72d2 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853228.051786:0:15012:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: ffff8f49415b7000/0x710df789068e72cb lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e72d2 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787853228.051795:0:15012:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1787853228.051801:0:15012:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787853228.051817:0:15012:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1787853228.051820:0:15012:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1787853228.051859:0:15012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f49415b7c00/0x710df789068e72d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853228.051867:0:15012:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.101@tcp lock: ffff8f49415b7c00/0x710df789068e72d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853228.051875:0:15012:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: ffff8f49415b7c00/0x710df789068e72d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853228.051894:0:15012:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49092bc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a76e730b-0783-4789-a5e2-a4230bb4bd66:15012:1874699552393344:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787853228.051937:0:15012:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853228.051988:0:15012:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f490316b0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787853228.052635:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552393344 00000100:00100000:1.0:1787853228.052644:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552393344 00000100:00100000:1.0:1787853228.052691:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787853228.052700:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f491040cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a76e730b-0783-4789-a5e2-a4230bb4bd66+13:15012:x1874699552393344:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787853228.052714:0:14322:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853228.052736:0:14322:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f492a8ad400/0x710df789068e72e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x710df789068e72d9 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853228.052759:0:14322:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f492a8ad400/0x710df789068e72e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x710df789068e72d9 expref: 14 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853228.052770:0:14322:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f492a8ad400/0x710df789068e72e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x710df789068e72d9 expref: 14 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853228.052777:0:14322:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f492a8ad400, rc 0) 00000100:00100000:1.0:1787853228.052831:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f491040cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a76e730b-0783-4789-a5e2-a4230bb4bd66+14:15012:x1874699552393344:12345-0@lo:101:mount.lustre.0 Request processed in 132us (895us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853228.052838:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787853228.053411:0:15012:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49092bc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a76e730b-0783-4789-a5e2-a4230bb4bd66:15012:1874699552393344:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787853228.053442:0:15012:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: ffff8f49415b7c00/0x710df789068e72d9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e72e0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853228.053461:0:15012:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: ffff8f49415b7c00/0x710df789068e72d9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x710df789068e72e0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787853228.054402:0:15012:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1787853228.056010:0:15012:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787853228.056264:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1787853228.056301:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1787853228.056328:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1787853228.056370:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1787853228.056399:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1787853228.056425:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1787853228.063514:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1787853228.063530:0:15012:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1787853228.063670:0:15012:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4803e66d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a76e730b-0783-4789-a5e2-a4230bb4bd66:15012:1874699552393472:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787853228.063741:0:15012:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853228.063788:0:15012:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f4901254840 going to sleep for 11 seconds 00000100:00100000:0.0:1787853228.064632:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552393472 00000100:00100000:0.0:1787853228.064640:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552393472 00000100:00100000:1.0:1787853228.064937:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787853228.064948:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49054a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a76e730b-0783-4789-a5e2-a4230bb4bd66+14:15012:x1874699552393472:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787853228.065475:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49054a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a76e730b-0783-4789-a5e2-a4230bb4bd66+14:15012:x1874699552393472:12345-0@lo:501:mount.lustre.0 Request processed in 528us (1732us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853228.065492:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787853228.065833:0:15012:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4803e66d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a76e730b-0783-4789-a5e2-a4230bb4bd66:15012:1874699552393472:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787853228.065902:0:15012:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4934114000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a76e730b-0783-4789-a5e2-a4230bb4bd66:15012:1874699552393600:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787853228.065949:0:15012:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853228.065987:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552393600 00000100:00100000:3.0:1787853228.065989:0:15012:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f49065f7b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787853228.065993:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552393600 00000100:00100000:1.0:1787853228.066023:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787853228.066030:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49054a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a76e730b-0783-4789-a5e2-a4230bb4bd66+14:15012:x1874699552393600:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787853228.066337:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49054a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a76e730b-0783-4789-a5e2-a4230bb4bd66+14:15012:x1874699552393600:12345-0@lo:503:mount.lustre.0 Request processed in 307us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853228.066345:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787853228.066586:0:15012:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4934114000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a76e730b-0783-4789-a5e2-a4230bb4bd66:15012:1874699552393600:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787853228.068219:0:15012:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787853228.068310:0:15012:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4803e64000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a76e730b-0783-4789-a5e2-a4230bb4bd66:15012:1874699552393728:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787853228.068396:0:15012:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853228.068441:0:15012:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f49011ca900 going to sleep for 11 seconds 00000100:00100000:3.0:1787853228.069563:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552393728 00000100:00100000:3.0:1787853228.069603:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552393728 00000100:00100000:3.0:1787853228.069650:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787853228.069660:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49054a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a76e730b-0783-4789-a5e2-a4230bb4bd66+14:15012:x1874699552393728:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787853228.069986:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49054a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a76e730b-0783-4789-a5e2-a4230bb4bd66+14:15012:x1874699552393728:12345-0@lo:502:mount.lustre.0 Request processed in 325us (1588us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853228.070005:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787853228.070778:0:15012:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4803e64000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a76e730b-0783-4789-a5e2-a4230bb4bd66:15012:1874699552393728:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787853228.071999:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1787853228.072093:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1787853228.073278:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1787853228.073363:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1787853228.073400:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1787853228.073615:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1787853228.073672:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1787853228.073707:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1787853228.073740:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:1.0:1787853228.073786:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:1.0:1787853228.075305:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:1.0:1787853228.075400:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:1.0:1787853228.076560:0:15012:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4803e64000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a76e730b-0783-4789-a5e2-a4230bb4bd66:15012:1874699552393856:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787853228.076669:0:15012:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853228.076738:0:15012:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f49011ca900 going to sleep for 11 seconds 00000100:00100000:0.0:1787853228.076916:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552393856 00000100:00100000:0.0:1787853228.076923:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552393856 00000100:00100000:0.0:1787853228.076973:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787853228.076981:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49054a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a76e730b-0783-4789-a5e2-a4230bb4bd66+14:15012:x1874699552393856:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787853228.078507:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49054a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a76e730b-0783-4789-a5e2-a4230bb4bd66+14:15012:x1874699552393856:12345-0@lo:502:mount.lustre.0 Request processed in 1520us (1832us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853228.078521:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787853228.078845:0:15012:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4803e64000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a76e730b-0783-4789-a5e2-a4230bb4bd66:15012:1874699552393856:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787853228.078979:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:1.0:1787853228.078995:0:15012:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:0.0:1787853228.086353:0:15026:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787853228.086364:0:15026:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1787853228.086372:0:15026:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787853228.086375:0:15026:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1787853228.086380:0:15026:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787853228.086395:0:15026:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8f49415e33a0) 00000020:00000080:0.0:1787853228.086416:0:15026:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:0.0:1787853228.086421:0:15026:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787853228.086510:0:15026:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f493483e000 from lustre-OST0000, refs=2 00080000:01000000:0.0:1787853228.086518:0:15026:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787853228.086528:0:15026:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x710df789068e72ee 00010000:00010000:0.0:1787853228.092356:0:15026:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:0.0:1787853228.093408:0:15026:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967326 00080000:10000000:0.0:1787853228.097422:0:15026:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:3.0:1787853228.100345:0:15026:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1787853228.100358:0:15026:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787853228.100365:0:15026:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787853228.100367:0:15026:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1787853228.100370:0:15026:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787853228.100372:0:15026:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:3.0:1787853228.100374:0:15026:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787853228.100375:0:15026:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787853228.100377:0:15026:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787853228.100379:0:15026:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787853228.100380:0:15026:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787853228.100383:0:15026:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787853228.100386:0:15026:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787853228.100387:0:15026:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787853228.100390:0:15026:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787853228.100392:0:15026:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787853228.100394:0:15026:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787853228.100396:0:15026:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787853228.100397:0:15026:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:3.0:1787853228.100399:0:15026:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787853228.100402:0:15026:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787853228.100403:0:15026:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787853228.100406:0:15026:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1787853228.100692:0:15026:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787853228.100698:0:15026:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787853228.100700:0:15026:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787853228.100704:0:15026:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:1.0:1787853228.101008:0:15012:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1787853228.101037:0:15012:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.101@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1787853228.101139:0:15012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f49415b7c00/0x710df789068e72d9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e72e0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853228.101153:0:15012:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: ffff8f49415b7c00/0x710df789068e72d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e72e0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787853228.101162:0:15012:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f493483e000 from 1 10000000:01000000:1.0:1787853228.101165:0:15012:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787853228.101201:0:15012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f492a8ad800/0x710df789068e72f5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853228.101209:0:15012:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.101@tcp lock: ffff8f492a8ad800/0x710df789068e72f5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853228.101220:0:15012:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: ffff8f492a8ad800/0x710df789068e72f5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853228.101243:0:15012:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4803e64000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a76e730b-0783-4789-a5e2-a4230bb4bd66:15012:1874699552393984:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787853228.101317:0:15012:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853228.101370:0:15012:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f49011ca780 going to sleep for 11 seconds 00000100:00100000:0.0:1787853228.101552:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552393984 00000100:00100000:0.0:1787853228.101562:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552393984 00000100:00100000:0.0:1787853228.101657:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787853228.101667:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49054a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a76e730b-0783-4789-a5e2-a4230bb4bd66+14:15012:x1874699552393984:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787853228.101680:0:14322:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853228.101695:0:14322:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f49415b7600/0x710df789068e72fc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x710df789068e72f5 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853228.101720:0:14322:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f49415b7600/0x710df789068e72fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x710df789068e72f5 expref: 15 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853228.101732:0:14322:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f49415b7600/0x710df789068e72fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x710df789068e72f5 expref: 15 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853228.101741:0:14322:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49415b7600, rc 0) 00000100:00100000:0.0:1787853228.101781:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49054a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a76e730b-0783-4789-a5e2-a4230bb4bd66+15:15012:x1874699552393984:12345-0@lo:101:mount.lustre.0 Request processed in 116us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853228.101787:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787853228.102227:0:15012:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4803e64000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a76e730b-0783-4789-a5e2-a4230bb4bd66:15012:1874699552393984:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787853228.102244:0:15012:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: ffff8f492a8ad800/0x710df789068e72f5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e72fc expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853228.102272:0:15012:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: ffff8f492a8ad800/0x710df789068e72f5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x710df789068e72fc expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787853228.104305:0:15012:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1787853228.107329:0:15012:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787853228.108367:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1787853228.109552:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1787853228.110607:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1787853228.110632:0:15012:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1787853228.110749:0:15012:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4803e64000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a76e730b-0783-4789-a5e2-a4230bb4bd66:15012:1874699552394112:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787853228.110824:0:15012:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853228.110880:0:15012:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f49011ca780 going to sleep for 11 seconds 00000100:00100000:0.0:1787853228.110976:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552394112 00000100:00100000:0.0:1787853228.110985:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552394112 00000100:00100000:0.0:1787853228.111035:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787853228.111113:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49054a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a76e730b-0783-4789-a5e2-a4230bb4bd66+15:15012:x1874699552394112:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787853228.111431:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49054a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a76e730b-0783-4789-a5e2-a4230bb4bd66+15:15012:x1874699552394112:12345-0@lo:501:mount.lustre.0 Request processed in 386us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853228.111438:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787853228.112192:0:15012:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4803e64000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a76e730b-0783-4789-a5e2-a4230bb4bd66:15012:1874699552394112:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787853228.112242:0:15012:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f492eb883c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a76e730b-0783-4789-a5e2-a4230bb4bd66:15012:1874699552394240:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787853228.112296:0:15012:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853228.112335:0:15012:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f4910aa0000 going to sleep for 11 seconds 00000100:00100000:0.0:1787853228.112670:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552394240 00000100:00100000:0.0:1787853228.112676:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552394240 00000100:00100000:0.0:1787853228.112706:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787853228.112715:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49054a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a76e730b-0783-4789-a5e2-a4230bb4bd66+15:15012:x1874699552394240:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787853228.114020:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49054a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a76e730b-0783-4789-a5e2-a4230bb4bd66+15:15012:x1874699552394240:12345-0@lo:503:mount.lustre.0 Request processed in 1301us (1718us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853228.114033:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787853228.119920:0:15012:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f492eb883c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a76e730b-0783-4789-a5e2-a4230bb4bd66:15012:1874699552394240:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787853228.122468:0:15012:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787853228.122584:0:15012:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f492eb883c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a76e730b-0783-4789-a5e2-a4230bb4bd66:15012:1874699552394368:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787853228.122998:0:15012:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853228.123057:0:15012:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f49412c4240 going to sleep for 11 seconds 00000100:00100000:3.0:1787853228.123382:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552394368 00000100:00100000:3.0:1787853228.123390:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552394368 00000100:00100000:3.0:1787853228.123445:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787853228.123464:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49054a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a76e730b-0783-4789-a5e2-a4230bb4bd66+15:15012:x1874699552394368:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787853228.123998:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49054a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a76e730b-0783-4789-a5e2-a4230bb4bd66+15:15012:x1874699552394368:12345-0@lo:502:mount.lustre.0 Request processed in 534us (999us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853228.124006:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787853228.124288:0:15012:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f492eb883c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a76e730b-0783-4789-a5e2-a4230bb4bd66:15012:1874699552394368:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787853228.124680:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1787853228.124737:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1787853228.124787:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1787853228.124839:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1787853228.124888:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1787853228.124934:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1787853228.124969:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1787853228.125000:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:0.0:1787853228.125038:0:15012:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49092bc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a76e730b-0783-4789-a5e2-a4230bb4bd66:15012:1874699552394496:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787853228.125425:0:15012:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853228.125489:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552394496 00000100:00100000:0.0:1787853228.125497:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552394496 00000100:00100000:0.0:1787853228.126736:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787853228.126754:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49054a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a76e730b-0783-4789-a5e2-a4230bb4bd66+15:15012:x1874699552394496:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787853228.127153:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49054a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a76e730b-0783-4789-a5e2-a4230bb4bd66+15:15012:x1874699552394496:12345-0@lo:502:mount.lustre.0 Request processed in 405us (1726us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853228.127163:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787853228.127378:0:15012:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f493c24e900 going to sleep for 11 seconds 00000100:00100000:1.0:1787853228.127404:0:15012:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49092bc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a76e730b-0783-4789-a5e2-a4230bb4bd66:15012:1874699552394496:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787853228.127560:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1787853228.127591:0:15012:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1787853228.129022:0:15030:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787853228.129033:0:15030:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787853228.129035:0:15030:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787853228.129054:0:15030:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f493483e000 00000020:00000080:1.0:1787853228.129056:0:15030:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787853228.129063:0:15030:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787853228.129065:0:15030:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787853228.129066:0:15030:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1787853228.129069:0:15030:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787853228.129071:0:15030:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787853228.129072:0:15030:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787853228.129075:0:15030:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f493483e000 00000020:00000080:1.0:1787853228.129077:0:15030:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787853228.129152:0:15030:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787853228.129155:0:15030:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787853228.129157:0:15030:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1787853228.129159:0:15030:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787853228.129162:0:15030:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787853228.129163:0:15030:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787853228.129166:0:15030:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8f493483e000 00000020:00000080:1.0:1787853228.129168:0:15030:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787853228.129202:0:15030:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787853228.129205:0:15030:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787853228.129206:0:15030:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1787853228.129209:0:15030:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1787853228.131736:0:15012:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1787853228.131773:0:15012:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787853228.133142:0:15012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f492a8ad800/0x710df789068e72f5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e72fc expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853228.133158:0:15012:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: ffff8f492a8ad800/0x710df789068e72f5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e72fc expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787853228.133212:0:15012:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787853228.133215:0:15012:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8f493483e000 10000000:01000000:3.0:1787853228.133218:0:15012:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8f493483e000 10000000:01000000:3.0:1787853228.133223:0:15012:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787853228.133230:0:15012:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8f493483e000 from 1 10000000:01000000:3.0:1787853228.133233:0:15012:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787853228.133273:0:15012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f4921e20400/0x710df789068e7303 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853228.133281:0:15012:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.101@tcp lock: ffff8f4921e20400/0x710df789068e7303 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853228.133291:0:15012:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: ffff8f4921e20400/0x710df789068e7303 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853228.133316:0:15012:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49341161c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a76e730b-0783-4789-a5e2-a4230bb4bd66:15012:1874699552394624:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787853228.133390:0:15012:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853228.133434:0:15012:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f490316b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787853228.133932:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552394624 00000100:00100000:0.0:1787853228.133940:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552394624 00000100:00100000:0.0:1787853228.134000:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787853228.134021:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49054a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a76e730b-0783-4789-a5e2-a4230bb4bd66+15:15012:x1874699552394624:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787853228.134036:0:14324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853228.134064:0:14324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f49415b7a00/0x710df789068e730a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x710df789068e7303 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853228.134089:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f49415b7a00/0x710df789068e730a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x710df789068e7303 expref: 16 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853228.134099:0:14324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f49415b7a00/0x710df789068e730a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x710df789068e7303 expref: 16 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853228.134108:0:14324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49415b7a00, rc 0) 00000100:00100000:0.0:1787853228.134168:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49054a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a76e730b-0783-4789-a5e2-a4230bb4bd66+16:15012:x1874699552394624:12345-0@lo:101:mount.lustre.0 Request processed in 152us (779us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853228.134175:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787853228.134769:0:15012:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49341161c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a76e730b-0783-4789-a5e2-a4230bb4bd66:15012:1874699552394624:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787853228.134789:0:15012:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: ffff8f4921e20400/0x710df789068e7303 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e730a expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853228.134801:0:15012:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: ffff8f4921e20400/0x710df789068e7303 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x710df789068e730a expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787853228.136296:0:15012:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:3.0:1787853228.138027:0:15012:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787853228.143242:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1787853228.143341:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1787853228.143378:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1787853228.143439:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1787853228.144320:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1787853228.144418:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1787853228.145737:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1787853228.145809:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1787853228.145894:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1787853228.145933:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1787853228.145968:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1787853228.146018:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1787853228.147398:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1787853228.148597:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1787853228.148792:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1787853228.148833:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1787853228.148908:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1787853228.148965:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1787853228.149006:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1787853228.150358:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1787853228.150548:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1787853228.150610:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1787853228.151610:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1787853228.151943:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1787853228.151985:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1787853228.152020:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1787853228.152082:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1787853228.152125:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1787853228.153834:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1787853228.153860:0:15012:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:3.0:1787853228.153974:0:15012:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49341161c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a76e730b-0783-4789-a5e2-a4230bb4bd66:15012:1874699552394752:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787853228.155217:0:15012:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853228.155606:0:15012:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f490316b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787853228.163317:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552394752 00000100:00100000:0.0:1787853228.163337:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552394752 00000100:00100000:0.0:1787853228.163415:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787853228.163427:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49054a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a76e730b-0783-4789-a5e2-a4230bb4bd66+16:15012:x1874699552394752:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787853228.164799:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49054a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a76e730b-0783-4789-a5e2-a4230bb4bd66+16:15012:x1874699552394752:12345-0@lo:501:mount.lustre.0 Request processed in 1367us (9578us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853228.164812:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787853228.173526:0:15012:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49341161c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a76e730b-0783-4789-a5e2-a4230bb4bd66:15012:1874699552394752:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787853228.175877:0:15012:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f492eb8a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a76e730b-0783-4789-a5e2-a4230bb4bd66:15012:1874699552394880:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787853228.175963:0:15012:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853228.176060:0:15012:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f49419c1180 going to sleep for 11 seconds 00000100:00100000:3.0:1787853228.176413:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552394880 00000100:00100000:3.0:1787853228.176422:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552394880 00000100:00100000:3.0:1787853228.176860:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787853228.176871:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49054a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a76e730b-0783-4789-a5e2-a4230bb4bd66+16:15012:x1874699552394880:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787853228.177293:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49054a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a76e730b-0783-4789-a5e2-a4230bb4bd66+16:15012:x1874699552394880:12345-0@lo:503:mount.lustre.0 Request processed in 423us (1329us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853228.177301:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787853228.179764:0:15012:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f492eb8a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a76e730b-0783-4789-a5e2-a4230bb4bd66:15012:1874699552394880:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787853228.180485:0:15012:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787853228.184285:0:15012:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f492eb8a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a76e730b-0783-4789-a5e2-a4230bb4bd66:15012:1874699552395008:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787853228.184381:0:15012:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853228.184436:0:15012:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f49419c1180 going to sleep for 11 seconds 00000100:00100000:1.0:1787853228.185251:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552395008 00000100:00100000:1.0:1787853228.185261:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552395008 00000100:00100000:1.0:1787853228.185320:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787853228.185330:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49053f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a76e730b-0783-4789-a5e2-a4230bb4bd66+16:15012:x1874699552395008:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787853228.185814:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49053f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a76e730b-0783-4789-a5e2-a4230bb4bd66+16:15012:x1874699552395008:12345-0@lo:502:mount.lustre.0 Request processed in 483us (1431us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853228.185824:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787853228.186200:0:15012:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f492eb8a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a76e730b-0783-4789-a5e2-a4230bb4bd66:15012:1874699552395008:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787853228.186716:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1787853228.186783:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1787853228.186821:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1787853228.186887:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1787853228.186927:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1787853228.187007:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1787853228.187238:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1787853228.187276:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1787853228.187321:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1787853228.187358:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1787853228.187394:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1787853228.187999:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1787853228.189799:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1787853228.189896:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1787853228.189985:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1787853228.190024:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1787853228.190216:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1787853228.190267:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1787853228.190297:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1787853228.190326:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1787853228.190377:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1787853228.190438:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1787853228.190544:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1787853228.190806:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1787853228.190859:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1787853228.190896:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1787853228.190947:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1787853228.190984:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1787853228.191020:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1787853228.191243:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1787853228.191283:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1787853228.191314:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1787853228.191348:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1787853228.191395:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1787853228.191521:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1787853228.191843:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1787853228.192123:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1787853228.192262:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1787853228.192316:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1787853228.192354:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1787853228.192410:0:15012:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4934114b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a76e730b-0783-4789-a5e2-a4230bb4bd66:15012:1874699552395136:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787853228.192777:0:15012:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853228.193226:0:15012:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f493c24e3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787853228.193275:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552395136 00000100:00100000:2.0:1787853228.193283:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552395136 00000100:00100000:2.0:1787853228.193389:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787853228.193402:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49053f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a76e730b-0783-4789-a5e2-a4230bb4bd66+16:15012:x1874699552395136:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787853228.194225:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49053f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a76e730b-0783-4789-a5e2-a4230bb4bd66+16:15012:x1874699552395136:12345-0@lo:502:mount.lustre.0 Request processed in 822us (1445us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853228.194236:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787853228.194476:0:15012:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4934114b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a76e730b-0783-4789-a5e2-a4230bb4bd66:15012:1874699552395136:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787853228.194837:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:2.0:1787853228.194881:0:15012:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1787853228.196361:0:15035:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1787853228.196398:0:15035:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8f4801184d70) 00000020:00000080:2.0:1787853228.196424:0:15035:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:2.0:1787853228.196528:0:15035:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f493483e000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787853228.196532:0:15035:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f493483e000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787853228.196535:0:15035:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f493483e000 3 00010000:00080000:2.0:1787853228.196807:0:15035:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f49079ee800@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.101@tcp at head 00010000:00010000:3.0:1787853228.199812:0:15035:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:3.0:1787853228.200186:0:15035:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1787853228.200227:0:15035:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787853228.200241:0:15035:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x710df789068e7318 00000100:00080000:3.0:1787853228.200252:0:15035:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787853228.200259:0:15035:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8f49079ee800 using connection 192.168.204.101@tcp/0@lo 00000100:00100000:3.0:1787853228.200295:0:15035:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f49341152c0 x1874699552395264/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787853228.200325:0:15035:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1787853228.200740:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49341152c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1874699552395264:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787853228.200817:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853228.200998:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552395264 00000100:00100000:3.0:1787853228.201006:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552395264 00000100:00100000:3.0:1787853228.201047:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787853228.201055:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f492eb8b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3305:x1874699552395264:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1787853228.201079:0:14331:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 547 last 0 00000020:00000080:3.0:1787853228.201113:0:14331:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x710df789068e731f 00000004:00100000:3.0:1787853228.201253:0:14331:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787853228.201293:0:14331:0:(import.c:65:import_set_state_nolock()) ffff8f4903013800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787853228.201353:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f492eb8b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874699552395264:12345-0@lo:38:llog_process_th.0 Request processed in 297us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853228.201368:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787853228.201412:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8f49341152c0 x1874699552395264/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787853238 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787853228.201422:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787853228.201429:0:3305:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1787853228.201448:0:3305:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787853228.202016:0:3305:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787853228.202020:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8f49079ee800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787853228.202028:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49341152c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1874699552395264:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1787853228.202943:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787853228.202949:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787853228.202953:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787853228.202956:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:3.0:1787853228.203257:0:15035:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000100:00100000:2.0:1787853228.203389:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49092bf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874699552395392:0@lo:400:kworker.0 00000100:00100000:2.0:1787853228.203447:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:0.0:1787853228.203741:0:15012:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1787853228.203767:0:15012:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787853228.203792:0:15012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f4921e20400/0x710df789068e7303 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e730a expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853228.203804:0:15012:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: ffff8f4921e20400/0x710df789068e7303 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e730a expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787853228.203869:0:15012:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787853228.203872:0:15012:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787853228.203874:0:15012:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787853228.203875:0:15012:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787853228.203876:0:15012:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787853228.203878:0:15012:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787853228.203880:0:15012:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787853228.203882:0:15012:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787853228.203883:0:15012:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787853228.203887:0:15012:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1787853228.203890:0:15012:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787853228.203891:0:15012:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787853228.203892:0:15012:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787853228.203893:0:15012:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787853228.203895:0:15012:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787853228.203896:0:15012:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787853228.203897:0:15012:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787853228.203898:0:15012:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787853228.203899:0:15012:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787853228.203919:0:15012:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1787853228.203932:0:15012:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49092bc3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a76e730b-0783-4789-a5e2-a4230bb4bd66:15012:1874699552395520:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787853228.203985:0:15012:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853228.204010:0:15012:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f492064e840 going to sleep for 11 seconds 00000100:00100000:3.0:1787853228.204244:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552395392 00000100:00100000:3.0:1787853228.204252:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552395392 00000100:00100000:3.0:1787853228.204304:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787853228.204314:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f492eb88b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874699552395392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853228.204371:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f492eb88b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874699552395392:12345-0@lo:400:kworker.0 Request processed in 59us (924us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853228.204379:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787853228.204418:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8f49092bf0c0 x1874699552395392/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787853244 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787853228.204431:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49092bf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874699552395392:0@lo:400:kworker.0 00000100:00100000:2.0:1787853228.204562:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552395520 00000100:00100000:2.0:1787853228.204594:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552395520 00000100:00100000:2.0:1787853228.204697:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787853228.204705:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49053f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a76e730b-0783-4789-a5e2-a4230bb4bd66+16:15012:x1874699552395520:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787853228.204728:0:14322:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1787853228.204743:0:14322:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787853228.260095:0:14322:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787853228.260117:0:14322:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1787853228.260246:0:14345:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787853228.260251:0:14345:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787853228.260275:0:14345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f492a8ace00/0x710df789068e7326 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853228.260294:0:14345:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f49415b6e00/0x710df789068e7293 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x710df789068e728c expref: 16 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853228.260304:0:14345:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f492a8ace00/0x710df789068e7326 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853228.260346:0:14345:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f49415b6e00/0x710df789068e7293 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x710df789068e728c expref: 16 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853228.260376:0:14345:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f49415b6e00/0x710df789068e7293 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x710df789068e728c expref: 16 pid: 14324 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853228.260392:0:14345:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4803e67480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14345:1874699552395648:0@lo:104: 00000100:00100000:1.0:1787853228.260533:0:14345:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853228.260607:0:14345:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f49062a3180 going to sleep for 11 seconds 00000100:00100000:0.0:1787853228.261232:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552395648 00000100:00100000:0.0:1787853228.261242:0:14312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552395648 00000100:00100000:0.0:1787853228.261609:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787853228.261635:0:14312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4803e64000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a76e730b-0783-4789-a5e2-a4230bb4bd66+3:14345:x1874699552395648:12345-0@lo:104: 00010000:00010000:0.0:1787853228.261657:0:14312:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.101@tcp lock: ffff8f49415b8e00/0x710df789068e728c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x710df789068e7293 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853228.261733:0:14312:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787853228.261739:0:14312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4803e64000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a76e730b-0783-4789-a5e2-a4230bb4bd66+3:14345:x1874699552395648:12345-0@lo:104: Request processed in 121us (1206us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853228.261746:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1787853228.261938:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787853228.261946:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.101@tcp lock: ffff8f49415b8e00/0x710df789068e728c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x710df789068e7293 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853228.261955:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b8e00 already unused, calling callback (ffffffffc1b55c20) 10000000:00010000:1.0:1787853228.261976:0:14317:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.101@tcp lock: ffff8f49415b8e00/0x710df789068e728c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x710df789068e7293 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853228.261986:0:14317:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.101@tcp lock: ffff8f49415b8e00/0x710df789068e728c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x710df789068e7293 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787853228.262001:0:14317:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.101@tcp lock: ffff8f49415b8e00/0x710df789068e728c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x710df789068e7293 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787853228.262008:0:14317:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787853228.262054:0:14317:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.101@tcp lock: ffff8f49415b8e00/0x710df789068e728c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x710df789068e7293 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853228.262060:0:14317:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787853228.262090:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.101@tcp lock: ffff8f49415b8e00/0x710df789068e728c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x710df789068e7293 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853228.262097:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.101@tcp lock: ffff8f49415b8e00/0x710df789068e728c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x710df789068e7293 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853228.262121:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853228.262123:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853228.262125:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787853228.262529:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787853228.262544:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4803e66d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a76e730b-0783-4789-a5e2-a4230bb4bd66:3307:1874699552395776:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787853228.262682:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853228.262756:0:14345:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4803e67480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14345:1874699552395648:0@lo:104: 00010000:00010000:1.0:1787853228.262775:0:14345:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f492a8ace00/0x710df789068e7326 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853228.263031:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552395776 00000100:00100000:3.0:1787853228.263038:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552395776 00010000:00010000:3.0:1787853228.263063:0:14316:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f49415b6e00/0x710df789068e7293 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x710df789068e728c expref: 17 pid: 14324 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853228.263094:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787853228.263102:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4803e64780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a76e730b-0783-4789-a5e2-a4230bb4bd66+17:3307:x1874699552395776:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787853228.263113:0:14316:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787853228.263118:0:14316:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f49415b6e00/0x710df789068e7293 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x710df789068e728c expref: 17 pid: 14324 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853228.264276:0:14316:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f49415b6e00/0x710df789068e7293 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x710df789068e728c expref: 17 pid: 14324 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853228.264818:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f49415b6e00/0x710df789068e7293 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x710df789068e728c expref: 17 pid: 14324 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853228.264839:0:14316:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f492a8ace00/0x710df789068e7326 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853228.264927:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f492a8ace00/0x710df789068e7326 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787853228.264945:0:14316:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004694809s 00010000:00010000:3.0:1787853228.264950:0:14316:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f492a8ace00/0x710df789068e7326 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853228.264957:0:14316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f492a8ace00/0x710df789068e7326 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853228.264963:0:14316:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f492a8ace00/0x710df789068e7326 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853228.264969:0:14316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f492a8ace00/0x710df789068e7326 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853228.264976:0:14316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f492a8ace00 already unused, calling callback (ffffffffc1528440) 00010000:00010000:3.0:1787853228.264980:0:14316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f492a8ace00/0x710df789068e7326 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853228.264988:0:14316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f492a8ace00/0x710df789068e7326 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853228.265003:0:14316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f492a8ace00/0x710df789068e7326 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853228.265033:0:14316:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787853228.265110:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4803e64780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a76e730b-0783-4789-a5e2-a4230bb4bd66+16:3307:x1874699552395776:12345-0@lo:103:ldlm_bl.0 Request processed in 2007us (2493us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853228.265119:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1787853228.265247:0:14345:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f492a8ace00/0x710df789068e7326 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853228.265257:0:14345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f492a8ace00/0x710df789068e7326 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853228.265263:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f492a8ace00/0x710df789068e7326 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853228.265310:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4803e66d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a76e730b-0783-4789-a5e2-a4230bb4bd66:3307:1874699552395776:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787853228.283288:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49053f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a76e730b-0783-4789-a5e2-a4230bb4bd66+15:15012:x1874699552395520:12345-0@lo:253:mount.lustre.0 Request processed in 78574us (79291us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853228.283303:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787853228.283412:0:15012:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49092bc3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a76e730b-0783-4789-a5e2-a4230bb4bd66:15012:1874699552395520:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787853228.283431:0:15012:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787853228.283435:0:15012:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787853228.283437:0:15012:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787853228.283438:0:15012:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787853228.283440:0:15012:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787853228.283441:0:15012:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787853228.283442:0:15012:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787853228.283443:0:15012:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787853228.283446:0:15012:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787853228.283458:0:15012:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787853228.283478:0:15012:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1787853228.297551:0:15012:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1787853228.297880:0:15012:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1787853228.298045:0:15012:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1787853228.298216:0:15012:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1787853228.298366:0:15012:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1787853228.299059:0:15012:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1787853228.300714:0:15012:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1787853228.350594:0:15012:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1787853228.350604:0:15012:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1787853228.350827:0:15012:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787853228.350967:0:15012:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.101@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787853228.350982:0:15012:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1787853228.351009:0:15012:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:3.0:1787853228.783674:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853229.803276:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787853229.866650:0:14326:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787853229.866659:0:14326:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8f493c6e5000 from 7 10000000:01000000:0.0:1787853229.866666:0:14326:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787853229.866725:0:14326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f49415b6400/0x710df789068e732d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853229.866738:0:14326:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.101@tcp lock: ffff8f49415b6400/0x710df789068e732d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853229.866755:0:14326:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: ffff8f49415b6400/0x710df789068e732d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853229.866790:0:14326:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49092bf840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a76e730b-0783-4789-a5e2-a4230bb4bd66:14326:1874699552395904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787853229.866890:0:14326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853229.866939:0:14326:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f490633e240 going to sleep for 11 seconds 00000100:00100000:2.0:1787853229.867732:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552395904 00000100:00100000:2.0:1787853229.867741:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552395904 00000100:00100000:2.0:1787853229.867810:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787853229.867830:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49053f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a76e730b-0783-4789-a5e2-a4230bb4bd66+15:14326:x1874699552395904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787853229.867845:0:14323:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853229.867860:0:14323:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f49415b9400/0x710df789068e7334 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x710df789068e732d expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853229.867885:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f49415b9400/0x710df789068e7334 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x710df789068e732d expref: 16 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853229.867896:0:14323:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f49415b9400/0x710df789068e7334 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x710df789068e732d expref: 16 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853229.867904:0:14323:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49415b9400, rc 0) 00000100:00100000:2.0:1787853229.867961:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49053f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a76e730b-0783-4789-a5e2-a4230bb4bd66+16:14326:x1874699552395904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (1072us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853229.867969:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787853229.868094:0:14326:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49092bf840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a76e730b-0783-4789-a5e2-a4230bb4bd66:14326:1874699552395904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787853229.868121:0:14326:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: ffff8f49415b6400/0x710df789068e732d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e7334 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853229.868135:0:14326:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: ffff8f49415b6400/0x710df789068e732d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x710df789068e7334 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853229.868194:0:14326:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49092bf840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a76e730b-0783-4789-a5e2-a4230bb4bd66:14326:1874699552396032:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787853229.868228:0:14326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853229.868264:0:14326:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f490633e240 going to sleep for 11 seconds 00000100:00100000:2.0:1787853229.868347:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552396032 00000100:00100000:2.0:1787853229.868351:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552396032 00000100:00100000:2.0:1787853229.868384:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787853229.868391:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49053f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a76e730b-0783-4789-a5e2-a4230bb4bd66+16:14326:x1874699552396032:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787853229.868416:0:14322:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787853229.868432:0:14322:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787853229.868435:0:14322:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1787853229.868509:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49053f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a76e730b-0783-4789-a5e2-a4230bb4bd66+16:14326:x1874699552396032:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 119us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853229.868516:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787853229.869102:0:14326:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49092bf840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a76e730b-0783-4789-a5e2-a4230bb4bd66:14326:1874699552396032:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787853229.869161:0:14326:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787853229.869167:0:14326:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f49415b6400/0x710df789068e732d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e7334 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853229.869176:0:14326:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: ffff8f49415b6400/0x710df789068e732d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e7334 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853230.831889:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853231.849816:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853232.878694:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787853233.388659:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787853233.388666:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787853233.388669:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787853233.388672:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787853233.388712:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787853233.388735:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4934117c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a76e730b-0783-4789-a5e2-a4230bb4bd66:3306:1874699552396160:0@lo:400:kworker.0 00000100:00100000:3.0:1787853233.389321:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853233.390730:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4934114780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874699552396288:0@lo:400:kworker.0 00000100:00100000:3.0:1787853233.390878:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853233.390917:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787853233.390924:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4934115e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1874699552396416:0@lo:400:kworker.0 00000100:00100000:3.0:1787853233.390949:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853233.390987:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552396160 00000100:00100000:3.0:1787853233.390996:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552396160 00000100:00100000:3.0:1787853233.394260:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787853233.394284:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49053f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a76e730b-0783-4789-a5e2-a4230bb4bd66+16:3306:x1874699552396160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853233.395194:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49053f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a76e730b-0783-4789-a5e2-a4230bb4bd66+16:3306:x1874699552396160:12345-0@lo:400:kworker.0 Request processed in 918us (5871us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853233.395216:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787853233.395275:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552396288 00000100:00100000:3.0:1787853233.395283:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552396288 00000100:00100000:3.0:1787853233.395316:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552396416 00000100:00100000:3.0:1787853233.395320:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552396416 00000100:00100000:3.0:1787853233.395344:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787853233.395356:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4934115680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874699552396288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853233.395403:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4934115680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874699552396288:12345-0@lo:400:kworker.0 Request processed in 53us (4527us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853233.395410:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787853233.395421:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787853233.395427:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49341152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874699552396416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853233.395455:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49341152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874699552396416:12345-0@lo:400:kworker.0 Request processed in 29us (4505us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853233.395461:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1787853233.395499:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787853233.395533:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f4934115e00 x1874699552396416/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787853249 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787853233.395549:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4934115e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1874699552396416:0@lo:400:kworker.0 00010000:00080000:3.0:1787853233.395560:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f4934114780 x1874699552396288/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787853249 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787853233.395585:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4934114780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874699552396288:0@lo:400:kworker.0 00000100:00100000:0.0:1787853233.396052:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4934117c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a76e730b-0783-4789-a5e2-a4230bb4bd66:3306:1874699552396160:0@lo:400:kworker.0 00010000:00010000:2.0:1787853233.899656:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787853234.420689:0:14361:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:1.0:1787853234.862141:0:15382:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg401-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787853234.924139:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853235.945952:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787853236.974799:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787853237.417728:0:3305:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787853222/real 1787853222] req@ffff8f4803e65a40 x1874699552391680/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787853237 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787853237.417776:0:3305:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8f4803e65a40 x1874699552391680/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787853237 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787853237.417788:0:3305:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787853222/real 1787853222] req@ffff8f4803e64b40 x1874699552391808/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787853237 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787853237.417800:0:3305:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8f4803e64b40 x1874699552391808/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787853237 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787853237.417823:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8f4908b0a000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787853237.417850:0:3305:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787853237.417855:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4803e65a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1874699552391680:0@lo:8:kworker.0 00000100:00080000:1.0:1787853237.417862:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8f4911cd3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787853237.417868:0:3305:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787853237.417871:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4803e64b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1874699552391808:0@lo:8:kworker.0 00000100:00080000:2.0:1787853237.418045:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787853237.418051:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1787853237.418054:0:38:0:(import.c:65:import_set_state_nolock()) ffff8f4908b0a000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787853237.418061:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 541 00000100:00080000:2.0:1787853237.418068:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787853237.418077:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8f4908b0a000 using connection 192.168.204.101@tcp/0@lo 00000100:00100000:2.0:1787853237.418105:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f492eb8ad00 x1874699552396672/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787853237.418123:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787853237.418126:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787853237.418127:0:38:0:(import.c:65:import_set_state_nolock()) ffff8f4911cd3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787853237.418131:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 541 00000100:00080000:2.0:1787853237.418134:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787853237.418139:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8f4911cd3800 using connection 192.168.204.101@tcp/0@lo 00000100:00100000:2.0:1787853237.418151:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f492eb89e00 x1874699552396800/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787853237.418220:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f492eb89680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1874699552397056:0@lo:400:kworker.0 00000100:00100000:2.0:1787853237.418325:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853237.418446:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552397056 00000100:00100000:2.0:1787853237.418456:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552397056 00000100:00100000:2.0:1787853237.418534:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787853237.418546:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f492eb8a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874699552397056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853237.418650:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f492eb8a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874699552397056:12345-0@lo:400:kworker.0 Request processed in 106us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853237.418659:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1787853237.418698:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787853237.418730:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f492eb89680 x1874699552397056/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787853253 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787853237.418744:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f492eb89680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1874699552397056:0@lo:400:kworker.0 00000100:00100000:1.0:1787853237.418831:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f492eb89a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874699552396928:0@lo:400:kworker.0 00000100:00100000:1.0:1787853237.418867:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853237.418911:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787853237.418918:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f492eb88f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a76e730b-0783-4789-a5e2-a4230bb4bd66:3307:1874699552396544:0@lo:400:kworker.0 00000100:00100000:1.0:1787853237.418953:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853237.418989:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552396544 00000100:00100000:1.0:1787853237.418993:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552396544 00000100:00100000:1.0:1787853237.419028:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787853237.419035:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49053f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a76e730b-0783-4789-a5e2-a4230bb4bd66+16:3307:x1874699552396544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853237.419072:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49053f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a76e730b-0783-4789-a5e2-a4230bb4bd66+16:3307:x1874699552396544:12345-0@lo:400:kworker.0 Request processed in 38us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853237.419088:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787853237.419132:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f492eb88f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a76e730b-0783-4789-a5e2-a4230bb4bd66:3307:1874699552396544:0@lo:400:kworker.0 00000100:00100000:1.0:1787853237.419151:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f492eb8ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1874699552396672:0@lo:8:kworker.0 00000100:00100000:1.0:1787853237.419187:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853237.419205:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f492eb89e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1874699552396800:0@lo:8:kworker.0 00000100:00100000:1.0:1787853237.419234:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853237.419272:0:15015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552396672 00000100:00100000:1.0:1787853237.419276:0:15015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552396672 00000100:00100000:1.0:1787853237.419294:0:15015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552396800 00000100:00100000:1.0:1787853237.419297:0:15015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552396800 00000100:00100000:1.0:1787853237.419308:0:15015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787853237.419313:0:15015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4803e65a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3305:x1874699552396672:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1787853237.419345:0:15015:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 556 last 0 00000020:00000080:1.0:1787853237.419388:0:15015:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x710df789068e733b 00002000:00100000:1.0:1787853237.419405:0:15015:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8f4801869800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113954 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1787853237.419409:0:15015:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1787853237.419413:0:15015:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1787853237.419904:0:15015:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787853237.419939:0:15015:0:(import.c:65:import_set_state_nolock()) ffff8f480186c000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787853237.419995:0:15015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4803e65a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3305:x1874699552396672:12345-0@lo:8:kworker.0 Request processed in 680us (807us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853237.420005:0:15015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787853237.420026:0:15015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787853237.420031:0:15015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4803e67840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3305:x1874699552396800:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1787853237.420044:0:15015:0:(ldlm_lib.c:1200:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:0.0:1787853237.420960:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f492eb8ad00 x1874699552396672/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787853257 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787853237.420975:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787853237.420986:0:3305:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1787853237.420996:0:3305:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787853237.421004:0:3305:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1787853237.421018:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8f4908b0a000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787853237.421045:0:3305:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787853237.421052:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f492eb8ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1874699552396672:0@lo:8:kworker.0 00000100:00100000:2.0:1787853237.421615:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552396928 00000100:00100000:2.0:1787853237.421625:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552396928 00000100:00100000:2.0:1787853237.421693:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787853237.421703:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4803e64b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874699552396928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853237.421793:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4803e64b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874699552396928:12345-0@lo:400:kworker.0 Request processed in 92us (2925us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853237.421801:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:2.0:1787853237.421868:0:14352:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:2.0:1787853237.421898:0:14352:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f492eb883c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14352:1874699552397312:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1787853237.421939:0:14352:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853237.421964:0:14352:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f4910a2cf00 going to sleep for 11 seconds 00000100:00100000:2.0:1787853237.421986:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f492eb89680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874699552397184:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787853237.422026:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1787853237.422081:0:14351:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1787853237.422608:0:14351:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 556964037034ns, next at 0ns, rc = 0 00000100:00100000:2.0:1787853237.422962:0:15017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552397184 00000100:00100000:2.0:1787853237.422971:0:15017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552397184 00000100:00100000:2.0:1787853237.423021:0:15017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787853237.423031:0:15017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f492eb8bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1874699552397184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787853237.423066:0:15017:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787853237.423129:0:15017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f492eb8bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1874699552397184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (1101us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853237.423137:0:15017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1787853237.423157:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787853237.423192:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f492eb89680 x1874699552397184/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787853253 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787853237.423217:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f492eb89680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874699552397184:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1787853237.423300:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f492eb89a40 x1874699552396928/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787853253 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787853237.423311:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f492eb89a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874699552396928:0@lo:400:kworker.0 00000100:00100000:0.0:1787853237.423635:0:15013:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1787853237.423647:0:15013:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1787853237.423856:0:15013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552397312 00000100:00100000:0.0:1787853237.423862:0:15013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552397312 00000100:00100000:0.0:1787853237.423971:0:15498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787853237.423981:0:15498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f492eb8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:14352:x1874699552397312:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1787853237.428894:0:15498:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1787853237.428911:0:15498:0:(ofd_dev.c:1643:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:0.0:1787853237.428918:0:15498:0:(ofd_dev.c:1494:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00002000:00010000:2.0:1787853237.474827:0:15498:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787853237.474845:0:15498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d10a0c71/0x710df789068e7342 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.474870:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=557s v=(0 0) 00010000:00010000:2.0:1787853237.474876:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787853237.474883:0:15498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d10a0c71/0x710df789068e7342 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.474907:0:15498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d10a0c71/0x710df789068e7342 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.474932:0:15498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d10a0c71/0x710df789068e7342 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.474942:0:15498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d10a0c71/0x710df789068e7342 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.474976:0:15498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787853237.475715:0:15498:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787853237.475723:0:15498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043610287/0x710df789068e7349 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853237.475727:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787853237.475738:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d10a0c71/0x710df789068e7342 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.475755:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=557s v=(0 0) 00010000:00010000:0.0:1787853237.475757:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b9e00 already unused, calling callback (ffffffffc1528440) 00010000:00010000:2.0:1787853237.475764:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787853237.475766:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d10a0c71/0x710df789068e7342 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.475772:0:15498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043610287/0x710df789068e7349 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853237.475783:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d10a0c71/0x710df789068e7342 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.475789:0:15498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043610287/0x710df789068e7349 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.475801:0:15498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043610287/0x710df789068e7349 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.475809:0:15498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043610287/0x710df789068e7349 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853237.475814:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d10a0c71/0x710df789068e7342 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853237.475826:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d10a0c71/0x710df789068e7342 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.475847:0:15498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787853237.475879:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787853237.475884:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043610287/0x710df789068e7349 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853237.475892:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b8200 already unused, calling callback (ffffffffc1528440) 00010000:00010000:0.0:1787853237.475896:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043610287/0x710df789068e7349 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853237.475904:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043610287/0x710df789068e7349 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853237.475917:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043610287/0x710df789068e7349 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853237.475926:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043610287/0x710df789068e7349 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853237.475946:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853237.475948:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853237.475951:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787853237.476312:0:15498:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787853237.476318:0:15498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a273a774/0x710df789068e7350 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.476328:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=557s v=(0 0) 00010000:00010000:2.0:1787853237.476331:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787853237.476336:0:15498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a273a774/0x710df789068e7350 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.476346:0:15498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a273a774/0x710df789068e7350 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.476354:0:15498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a273a774/0x710df789068e7350 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.476361:0:15498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a273a774/0x710df789068e7350 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.476382:0:15498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787853237.477119:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787853237.477135:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a273a774/0x710df789068e7350 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853237.477145:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b9000 already unused, calling callback (ffffffffc1528440) 00010000:00010000:3.0:1787853237.477149:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a273a774/0x710df789068e7350 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853237.477158:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a273a774/0x710df789068e7350 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853237.477178:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a273a774/0x710df789068e7350 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853237.477186:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a273a774/0x710df789068e7350 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853237.477209:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787853237.477211:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787853237.477213:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787853237.477370:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787853237.484294:0:15498:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787853237.484315:0:15498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a09b17bb/0x710df789068e7357 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.484339:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=557s v=(0 0) 00010000:00010000:2.0:1787853237.484359:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787853237.484368:0:15498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a09b17bb/0x710df789068e7357 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.484388:0:15498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a09b17bb/0x710df789068e7357 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.484400:0:15498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a09b17bb/0x710df789068e7357 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.484409:0:15498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a09b17bb/0x710df789068e7357 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.484432:0:15498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787853237.485117:0:15498:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787853237.485124:0:15498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff26dc11/0x710df789068e735e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.485135:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=557s v=(0 0) 00010000:00010000:2.0:1787853237.485139:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787853237.485143:0:15498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff26dc11/0x710df789068e735e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.485154:0:15498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff26dc11/0x710df789068e735e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.485163:0:15498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff26dc11/0x710df789068e735e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.485179:0:15498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ff26dc11/0x710df789068e735e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.485198:0:15498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1787853237.485719:0:15498:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787853237.485725:0:15498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf5a234f/0x710df789068e7365 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.485735:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=557s v=(0 0) 00010000:00010000:2.0:1787853237.485739:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787853237.485743:0:15498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf5a234f/0x710df789068e7365 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.485753:0:15498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf5a234f/0x710df789068e7365 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.485762:0:15498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf5a234f/0x710df789068e7365 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.485770:0:15498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cf5a234f/0x710df789068e7365 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.485779:0:15498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1787853237.486271:0:15498:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787853237.486279:0:15498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000881192f3/0x710df789068e736c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.486296:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=557s v=(0 0) 00010000:00010000:2.0:1787853237.486300:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787853237.486304:0:15498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000881192f3/0x710df789068e736c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.486316:0:15498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000881192f3/0x710df789068e736c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.486325:0:15498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000881192f3/0x710df789068e736c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.486332:0:15498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000881192f3/0x710df789068e736c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.486342:0:15498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:1.0:1787853237.487838:0:15015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4803e67840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3305:x1874699552396800:12345-0@lo:8:kworker.0 Request processed in 67792us (68590us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787853237.487857:0:15015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1787853237.488040:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8f4911cd3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787853237.488048:0:3305:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787853237.488053:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f492eb89e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1874699552396800:0@lo:8:kworker.0 00010000:00010000:1.0:1787853237.489080:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1787853237.489097:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a09b17bb/0x710df789068e7357 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853237.489115:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b9200 already unused, calling callback (ffffffffc1528440) 00010000:00010000:1.0:1787853237.489121:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a09b17bb/0x710df789068e7357 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853237.489134:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a09b17bb/0x710df789068e7357 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853237.489168:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a09b17bb/0x710df789068e7357 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853237.489177:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a09b17bb/0x710df789068e7357 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853237.489344:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787853237.489351:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ff26dc11/0x710df789068e735e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853237.489358:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b9c00 already unused, calling callback (ffffffffc1528440) 00010000:00010000:1.0:1787853237.489362:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff26dc11/0x710df789068e735e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853237.489384:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff26dc11/0x710df789068e735e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853237.489396:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ff26dc11/0x710df789068e735e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853237.489404:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff26dc11/0x710df789068e735e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853237.489417:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787853237.489421:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cf5a234f/0x710df789068e7365 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853237.489427:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b8e00 already unused, calling callback (ffffffffc1528440) 00010000:00010000:1.0:1787853237.489430:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf5a234f/0x710df789068e7365 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853237.489437:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf5a234f/0x710df789068e7365 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853237.489445:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cf5a234f/0x710df789068e7365 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853237.489453:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf5a234f/0x710df789068e7365 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853237.489478:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787853237.489482:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000881192f3/0x710df789068e736c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853237.489489:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b8c00 already unused, calling callback (ffffffffc1528440) 00010000:00010000:1.0:1787853237.489492:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000881192f3/0x710df789068e736c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853237.489501:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000881192f3/0x710df789068e736c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853237.489512:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000881192f3/0x710df789068e736c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853237.489520:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000881192f3/0x710df789068e736c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853237.489533:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853237.489534:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853237.489536:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853237.489547:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787853237.497141:0:15498:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787853237.497161:0:15498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000171d645e/0x710df789068e7373 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.497185:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=557s v=(0 0) 00010000:00010000:2.0:1787853237.497191:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787853237.497200:0:15498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000171d645e/0x710df789068e7373 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.497220:0:15498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000171d645e/0x710df789068e7373 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.497246:0:15498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000171d645e/0x710df789068e7373 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.497255:0:15498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000171d645e/0x710df789068e7373 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.497275:0:15498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787853237.497369:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787853237.497381:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000171d645e/0x710df789068e7373 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853237.497393:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b9600 already unused, calling callback (ffffffffc1528440) 00010000:00010000:1.0:1787853237.497405:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000171d645e/0x710df789068e7373 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853237.497416:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000171d645e/0x710df789068e7373 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853237.497444:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000171d645e/0x710df789068e7373 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853237.497454:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000171d645e/0x710df789068e7373 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853237.497479:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853237.497482:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853237.497483:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787853237.498130:0:15498:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787853237.498137:0:15498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d277965a/0x710df789068e737a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.498149:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=557s v=(0 0) 00010000:00010000:2.0:1787853237.498153:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787853237.498158:0:15498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d277965a/0x710df789068e737a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.498169:0:15498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d277965a/0x710df789068e737a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.498179:0:15498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d277965a/0x710df789068e737a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.498188:0:15498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d277965a/0x710df789068e737a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.498222:0:15498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787853237.499382:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787853237.499396:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d277965a/0x710df789068e737a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853237.499411:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b8800 already unused, calling callback (ffffffffc1528440) 00010000:00010000:1.0:1787853237.499416:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d277965a/0x710df789068e737a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853237.499430:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d277965a/0x710df789068e737a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853237.499456:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d277965a/0x710df789068e737a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853237.499475:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d277965a/0x710df789068e737a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853237.499507:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853237.499509:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853237.499512:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787853237.499620:0:15498:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787853237.499628:0:15498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003cccac84/0x710df789068e7381 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.499640:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=557s v=(0 0) 00010000:00010000:2.0:1787853237.499645:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787853237.499652:0:15498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003cccac84/0x710df789068e7381 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.499677:0:15498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003cccac84/0x710df789068e7381 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.499688:0:15498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003cccac84/0x710df789068e7381 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.499696:0:15498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003cccac84/0x710df789068e7381 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.499716:0:15498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787853237.499730:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787853237.499735:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003cccac84/0x710df789068e7381 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.499743:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b8a00 already unused, calling callback (ffffffffc1528440) 00010000:00010000:2.0:1787853237.499755:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003cccac84/0x710df789068e7381 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.499764:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003cccac84/0x710df789068e7381 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.499779:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003cccac84/0x710df789068e7381 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.499788:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003cccac84/0x710df789068e7381 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.499803:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853237.499806:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853237.499807:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787853237.502115:0:15498:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787853237.502134:0:15498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000854d8157/0x710df789068e7388 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.502156:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=557s v=(0 0) 00010000:00010000:2.0:1787853237.502162:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787853237.502171:0:15498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000854d8157/0x710df789068e7388 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.502189:0:15498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000854d8157/0x710df789068e7388 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.502203:0:15498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000854d8157/0x710df789068e7388 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.502220:0:15498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000854d8157/0x710df789068e7388 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.502254:0:15498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787853237.502278:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787853237.502285:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000854d8157/0x710df789068e7388 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.502295:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b8000 already unused, calling callback (ffffffffc1528440) 00010000:00010000:2.0:1787853237.502300:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000854d8157/0x710df789068e7388 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.502311:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000854d8157/0x710df789068e7388 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.502332:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000854d8157/0x710df789068e7388 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.502340:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000854d8157/0x710df789068e7388 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.502364:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853237.502365:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853237.502367:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787853237.503064:0:15498:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787853237.503082:0:15498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a3448dd/0x710df789068e738f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.503093:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=557s v=(0 0) 00010000:00010000:2.0:1787853237.503097:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787853237.503102:0:15498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a3448dd/0x710df789068e738f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.503114:0:15498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005a3448dd/0x710df789068e738f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.503123:0:15498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a3448dd/0x710df789068e738f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.503131:0:15498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005a3448dd/0x710df789068e738f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.503153:0:15498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787853237.503168:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787853237.503174:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005a3448dd/0x710df789068e738f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.503182:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b8600 already unused, calling callback (ffffffffc1528440) 00010000:00010000:2.0:1787853237.503187:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005a3448dd/0x710df789068e738f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.503195:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005a3448dd/0x710df789068e738f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.503218:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005a3448dd/0x710df789068e738f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.503226:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005a3448dd/0x710df789068e738f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.503243:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853237.503244:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853237.503246:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787853237.503789:0:15498:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787853237.503796:0:15498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2132c01/0x710df789068e7396 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.503808:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=557s v=(0 0) 00010000:00010000:2.0:1787853237.503812:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787853237.503816:0:15498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2132c01/0x710df789068e7396 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.503826:0:15498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2132c01/0x710df789068e7396 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.503833:0:15498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2132c01/0x710df789068e7396 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.503841:0:15498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e2132c01/0x710df789068e7396 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.503871:0:15498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787853237.503882:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787853237.503887:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e2132c01/0x710df789068e7396 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.503894:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4906502e00 already unused, calling callback (ffffffffc1528440) 00010000:00010000:2.0:1787853237.503897:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2132c01/0x710df789068e7396 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.503905:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2132c01/0x710df789068e7396 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.503918:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e2132c01/0x710df789068e7396 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.503925:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2132c01/0x710df789068e7396 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.503941:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853237.503943:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853237.503944:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787853237.504453:0:15498:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787853237.504461:0:15498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d57dc57/0x710df789068e739d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.504472:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=557s v=(0 0) 00010000:00010000:2.0:1787853237.504483:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787853237.504488:0:15498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d57dc57/0x710df789068e739d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.504500:0:15498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000d57dc57/0x710df789068e739d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.504509:0:15498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d57dc57/0x710df789068e739d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.504516:0:15498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000d57dc57/0x710df789068e739d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.504533:0:15498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787853237.504545:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787853237.504550:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000d57dc57/0x710df789068e739d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.504558:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4906502400 already unused, calling callback (ffffffffc1528440) 00010000:00010000:2.0:1787853237.504562:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000d57dc57/0x710df789068e739d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.504598:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000d57dc57/0x710df789068e739d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.504610:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000d57dc57/0x710df789068e739d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.504630:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000d57dc57/0x710df789068e739d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787853237.505874:0:15498:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787853237.505887:0:15498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8fa5a29/0x710df789068e73a4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853237.505902:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=557s v=(0 0) 00010000:00010000:3.0:1787853237.505907:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787853237.505913:0:15498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8fa5a29/0x710df789068e73a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853237.505938:0:15498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d8fa5a29/0x710df789068e73a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853237.505949:0:15498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8fa5a29/0x710df789068e73a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853237.505958:0:15498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d8fa5a29/0x710df789068e73a4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853237.505977:0:15498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787853237.506721:0:15498:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787853237.506730:0:15498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ebbd98f0/0x710df789068e73ab lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853237.506741:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=557s v=(0 0) 00010000:00010000:3.0:1787853237.506745:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787853237.506750:0:15498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ebbd98f0/0x710df789068e73ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853237.506763:0:15498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ebbd98f0/0x710df789068e73ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853237.506772:0:15498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ebbd98f0/0x710df789068e73ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853237.506794:0:15498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ebbd98f0/0x710df789068e73ab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853237.506805:0:15498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1787853237.507282:0:15498:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787853237.507289:0:15498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005e382b0/0x710df789068e73b2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853237.507299:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=557s v=(0 0) 00010000:00010000:3.0:1787853237.507302:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787853237.507306:0:15498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000005e382b0/0x710df789068e73b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853237.507317:0:15498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000005e382b0/0x710df789068e73b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853237.507326:0:15498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005e382b0/0x710df789068e73b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853237.507334:0:15498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000005e382b0/0x710df789068e73b2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853237.507342:0:15498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1787853237.510108:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787853237.510126:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d8fa5a29/0x710df789068e73a4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.510142:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4921e21600 already unused, calling callback (ffffffffc1528440) 00010000:00010000:2.0:1787853237.510148:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8fa5a29/0x710df789068e73a4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.510161:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8fa5a29/0x710df789068e73a4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.510195:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d8fa5a29/0x710df789068e73a4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.510204:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d8fa5a29/0x710df789068e73a4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.510227:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787853237.510231:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ebbd98f0/0x710df789068e73ab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.510237:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4921e20800 already unused, calling callback (ffffffffc1528440) 00010000:00010000:2.0:1787853237.510246:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ebbd98f0/0x710df789068e73ab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.510254:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ebbd98f0/0x710df789068e73ab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.510266:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ebbd98f0/0x710df789068e73ab lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.510273:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ebbd98f0/0x710df789068e73ab lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.510286:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787853237.510290:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000005e382b0/0x710df789068e73b2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.510296:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4921e21e00 already unused, calling callback (ffffffffc1528440) 00010000:00010000:2.0:1787853237.510299:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000005e382b0/0x710df789068e73b2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.510307:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000005e382b0/0x710df789068e73b2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.510316:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000005e382b0/0x710df789068e73b2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.510323:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000005e382b0/0x710df789068e73b2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.510343:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853237.510346:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853237.510348:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853237.510367:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787853237.511284:0:15498:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787853237.511297:0:15498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd1409f2/0x710df789068e73b9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853237.511320:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=557s v=(0 0) 00010000:00010000:3.0:1787853237.511326:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787853237.511334:0:15498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd1409f2/0x710df789068e73b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853237.511910:0:15498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd1409f2/0x710df789068e73b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853237.511921:0:15498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd1409f2/0x710df789068e73b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853237.511930:0:15498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fd1409f2/0x710df789068e73b9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853237.511949:0:15498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787853237.512110:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787853237.512118:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fd1409f2/0x710df789068e73b9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.512127:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4921e21400 already unused, calling callback (ffffffffc1528440) 00010000:00010000:2.0:1787853237.512136:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd1409f2/0x710df789068e73b9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.514283:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd1409f2/0x710df789068e73b9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.514337:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fd1409f2/0x710df789068e73b9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.514347:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd1409f2/0x710df789068e73b9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.514386:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853237.514389:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853237.514392:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787853237.521159:0:15498:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787853237.521187:0:15498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096365921/0x710df789068e73c0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853237.521212:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=557s v=(0 0) 00010000:00010000:3.0:1787853237.521219:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787853237.521228:0:15498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096365921/0x710df789068e73c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853237.521249:0:15498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000096365921/0x710df789068e73c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853237.521285:0:15498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096365921/0x710df789068e73c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853237.521295:0:15498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000096365921/0x710df789068e73c0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853237.521331:0:15498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787853237.522688:0:15498:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787853237.522698:0:15498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac81386a/0x710df789068e73c7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853237.522715:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=557s v=(0 0) 00010000:00010000:3.0:1787853237.522719:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787853237.522725:0:15498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac81386a/0x710df789068e73c7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853237.522739:0:15498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ac81386a/0x710df789068e73c7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853237.522750:0:15498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac81386a/0x710df789068e73c7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853237.522758:0:15498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ac81386a/0x710df789068e73c7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853237.522793:0:15498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787853237.523860:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787853237.523883:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000096365921/0x710df789068e73c0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.523907:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4921e20600 already unused, calling callback (ffffffffc1528440) 00010000:00010000:2.0:1787853237.523913:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000096365921/0x710df789068e73c0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.523925:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000096365921/0x710df789068e73c0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.523950:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000096365921/0x710df789068e73c0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.523959:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096365921/0x710df789068e73c0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.523985:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787853237.523988:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ac81386a/0x710df789068e73c7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.523995:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4921e20a00 already unused, calling callback (ffffffffc1528440) 00010000:00010000:2.0:1787853237.523998:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac81386a/0x710df789068e73c7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.524005:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac81386a/0x710df789068e73c7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.524015:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ac81386a/0x710df789068e73c7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.524028:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac81386a/0x710df789068e73c7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.524041:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853237.524043:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853237.524045:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853237.524077:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787853237.532337:0:15498:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787853237.532359:0:15498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008dbaa99c/0x710df789068e73ce lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853237.532383:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=557s v=(0 0) 00010000:00010000:3.0:1787853237.532389:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787853237.532398:0:15498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008dbaa99c/0x710df789068e73ce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853237.532414:0:15498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008dbaa99c/0x710df789068e73ce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853237.532425:0:15498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008dbaa99c/0x710df789068e73ce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853237.532434:0:15498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008dbaa99c/0x710df789068e73ce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853237.532466:0:15498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787853237.532947:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787853237.532958:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008dbaa99c/0x710df789068e73ce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853237.532976:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4921e20e00 already unused, calling callback (ffffffffc1528440) 00010000:00010000:0.0:1787853237.532992:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008dbaa99c/0x710df789068e73ce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853237.533004:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008dbaa99c/0x710df789068e73ce lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853237.533028:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008dbaa99c/0x710df789068e73ce lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853237.533036:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008dbaa99c/0x710df789068e73ce lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853237.533062:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853237.533064:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853237.533066:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787853237.533801:0:15498:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787853237.533812:0:15498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010ae181f/0x710df789068e73d5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853237.533825:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=557s v=(0 0) 00010000:00010000:3.0:1787853237.533839:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787853237.533847:0:15498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010ae181f/0x710df789068e73d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853237.533861:0:15498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010ae181f/0x710df789068e73d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853237.533871:0:15498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010ae181f/0x710df789068e73d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853237.533880:0:15498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000010ae181f/0x710df789068e73d5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853237.533907:0:15498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787853237.534499:0:15498:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787853237.534505:0:15498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1b94c8c/0x710df789068e73dc lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853237.534515:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=557s v=(0 0) 00010000:00010000:3.0:1787853237.534518:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787853237.534521:0:15498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1b94c8c/0x710df789068e73dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853237.534531:0:15498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e1b94c8c/0x710df789068e73dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853237.534539:0:15498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1b94c8c/0x710df789068e73dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853237.534552:0:15498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e1b94c8c/0x710df789068e73dc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853237.534566:0:15498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787853237.535004:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787853237.535015:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000010ae181f/0x710df789068e73d5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.535028:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4921e21000 already unused, calling callback (ffffffffc1528440) 00010000:00010000:2.0:1787853237.535034:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000010ae181f/0x710df789068e73d5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.535046:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000010ae181f/0x710df789068e73d5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.535073:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000010ae181f/0x710df789068e73d5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.535083:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010ae181f/0x710df789068e73d5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.535106:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787853237.535110:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e1b94c8c/0x710df789068e73dc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.535129:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4921e20200 already unused, calling callback (ffffffffc1528440) 00010000:00010000:2.0:1787853237.535132:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1b94c8c/0x710df789068e73dc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.535142:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1b94c8c/0x710df789068e73dc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.535153:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e1b94c8c/0x710df789068e73dc lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.535161:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1b94c8c/0x710df789068e73dc lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.535175:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853237.535177:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853237.535178:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853237.536864:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787853237.539174:0:15498:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787853237.539199:0:15498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f6caeca/0x710df789068e73e3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853237.539225:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=557s v=(0 0) 00010000:00010000:3.0:1787853237.539232:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787853237.539240:0:15498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f6caeca/0x710df789068e73e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853237.539259:0:15498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f6caeca/0x710df789068e73e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853237.539271:0:15498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f6caeca/0x710df789068e73e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853237.539280:0:15498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f6caeca/0x710df789068e73e3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853237.539305:0:15498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787853237.540055:0:15498:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787853237.540064:0:15498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c881a93d/0x710df789068e73ea lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853237.540086:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=557s v=(0 0) 00010000:00010000:3.0:1787853237.540091:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787853237.540096:0:15498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c881a93d/0x710df789068e73ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853237.540108:0:15498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c881a93d/0x710df789068e73ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853237.540119:0:15498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c881a93d/0x710df789068e73ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853237.540127:0:15498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c881a93d/0x710df789068e73ea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853237.540155:0:15498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787853237.540375:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787853237.540388:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f6caeca/0x710df789068e73e3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853237.540479:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4921e21200 already unused, calling callback (ffffffffc1528440) 00010000:00010000:1.0:1787853237.540488:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f6caeca/0x710df789068e73e3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853237.540502:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f6caeca/0x710df789068e73e3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853237.540532:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f6caeca/0x710df789068e73e3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853237.540542:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f6caeca/0x710df789068e73e3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853237.540600:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787853237.540605:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c881a93d/0x710df789068e73ea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853237.540620:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4921e20000 already unused, calling callback (ffffffffc1528440) 00010000:00010000:1.0:1787853237.540624:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c881a93d/0x710df789068e73ea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853237.540632:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c881a93d/0x710df789068e73ea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853237.540644:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c881a93d/0x710df789068e73ea lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853237.540652:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c881a93d/0x710df789068e73ea lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853237.540680:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853237.540682:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853237.540684:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787853237.540700:0:15498:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787853237.540708:0:15498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003fa2ba9a/0x710df789068e73f1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853237.540716:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=557s v=(0 0) 00010000:00010000:3.0:1787853237.540720:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787853237.540725:0:15498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003fa2ba9a/0x710df789068e73f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853237.540734:0:15498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003fa2ba9a/0x710df789068e73f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853237.540755:0:15498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003fa2ba9a/0x710df789068e73f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853237.540762:0:15498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003fa2ba9a/0x710df789068e73f1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853237.540781:0:15498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787853237.540961:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787853237.540968:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003fa2ba9a/0x710df789068e73f1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853237.540975:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4921e20c00 already unused, calling callback (ffffffffc1528440) 00010000:00010000:1.0:1787853237.540979:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003fa2ba9a/0x710df789068e73f1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853237.540987:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003fa2ba9a/0x710df789068e73f1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853237.541007:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003fa2ba9a/0x710df789068e73f1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853237.541013:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003fa2ba9a/0x710df789068e73f1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853237.541028:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853237.541030:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853237.541031:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787853237.541234:0:15498:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787853237.541241:0:15498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac81386a/0x710df789068e73f8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853237.541250:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=557s v=(0 0) 00010000:00010000:3.0:1787853237.541253:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787853237.541258:0:15498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac81386a/0x710df789068e73f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853237.541268:0:15498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ac81386a/0x710df789068e73f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853237.541276:0:15498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac81386a/0x710df789068e73f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853237.541283:0:15498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ac81386a/0x710df789068e73f8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853237.541314:0:15498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787853237.541344:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787853237.541350:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ac81386a/0x710df789068e73f8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853237.541358:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4921e20a00 already unused, calling callback (ffffffffc1528440) 00010000:00010000:1.0:1787853237.541362:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac81386a/0x710df789068e73f8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853237.541371:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac81386a/0x710df789068e73f8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853237.541384:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ac81386a/0x710df789068e73f8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853237.541391:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac81386a/0x710df789068e73f8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853237.541489:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853237.541491:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853237.541493:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1787853237.541506:0:15498:0:(ofd_dev.c:1521:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00000100:00100000:2.0:1787853237.541720:0:14352:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f492eb883c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14352:1874699552397312:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1787853237.541743:0:14352:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:2.0:1787853237.541809:0:14352:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f492eb883c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14352:1874699552397440:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1787853237.541857:0:14352:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787853237.541907:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787853237.545780:0:14352:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f4910a2cf00 going to sleep for 11 seconds 00000100:00100000:2.0:1787853237.545853:0:15013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552397440 00000100:00100000:2.0:1787853237.545879:0:15013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552397440 00000100:00100000:2.0:1787853237.545985:0:15013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787853237.546000:0:15013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f492eb89a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14352:x1874699552397440:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1787853237.546112:0:15013:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:3.0:1787853237.547451:0:15498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f492eb8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:14352:x1874699552397312:12345-0@lo:5:osp-pre-0-0.0 Request processed in 123459us (125498us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853237.553278:0:15498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787853237.558788:0:15013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f492eb89a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14352:x1874699552397440:12345-0@lo:5:osp-pre-0-0.0 Request processed in 12772us (16911us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1787853237.558812:0:15013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787853237.558854:0:14352:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f492eb883c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14352:1874699552397440:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1787853237.558880:0:14352:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00000004:00080000:0.0:1787853237.569476:0:5858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:1.0:1787853238.003147:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787853238.601718:0:6712:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1787853238.601743:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00010000:00010000:0.0:1787853239.019855:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853240.044372:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853241.066053:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853242.090819:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787853242.602754:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787853242.602762:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787853242.602766:0:38:0:(import.c:65:import_set_state_nolock()) ffff8f4911cd3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787853242.602775:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 556 00000100:00080000:2.0:1787853242.602781:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1787853242.602788:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8f4911cd3800 using connection 192.168.204.101@tcp/0@lo 00000100:00100000:2.0:1787853242.602813:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f492eb8a940 x1874699552397952/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787853242.602869:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f492eb88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874699552397824:0@lo:400:kworker.0 00000100:00100000:2.0:1787853242.602940:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853242.603046:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4934116d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552397568:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787853242.603076:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853242.603102:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f492eb892c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a76e730b-0783-4789-a5e2-a4230bb4bd66:3306:1874699552397696:0@lo:400:kworker.0 00000100:00100000:0.0:1787853242.603142:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853242.603183:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f492eb8a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1874699552397952:0@lo:8:kworker.0 00000100:00100000:0.0:1787853242.603222:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853242.603258:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552397696 00000100:00100000:0.0:1787853242.603264:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552397696 00000100:00100000:3.0:1787853242.603279:0:15498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552397824 00000100:00100000:3.0:1787853242.603283:0:15498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552397824 00000100:00100000:0.0:1787853242.603306:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787853242.603314:0:15498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552397952 00000100:00100000:0.0:1787853242.603314:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49053f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a76e730b-0783-4789-a5e2-a4230bb4bd66+16:3306:x1874699552397696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853242.603317:0:15498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552397952 00000100:00100000:3.0:1787853242.603331:0:15498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787853242.603336:0:15498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f492eb89680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1874699552397824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853242.603366:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49053f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a76e730b-0783-4789-a5e2-a4230bb4bd66+16:3306:x1874699552397696:12345-0@lo:400:kworker.0 Request processed in 52us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853242.603367:0:15498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f492eb89680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1874699552397824:12345-0@lo:400:kworker.0 Request processed in 32us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853242.603373:0:15498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787853242.603373:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787853242.603428:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f492eb892c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a76e730b-0783-4789-a5e2-a4230bb4bd66:3306:1874699552397696:0@lo:400:kworker.0 00000100:00100000:3.0:1787853242.603462:0:15498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787853242.603533:0:15498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49092be940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3305:x1874699552397952:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1787853242.603553:0:15498:0:(ldlm_lib.c:1200:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787853242.606801:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1787853242.606848:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f492eb88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874699552397824:0@lo:400:kworker.0 00000100:00100000:2.0:1787853242.606875:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f492eb8a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874699552398080:0@lo:400:kworker.0 00000100:00100000:2.0:1787853242.606938:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853242.606989:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787853242.606997:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f492eb88780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1874699552398208:0@lo:400:kworker.0 00000100:00100000:2.0:1787853242.607020:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853242.607097:0:15017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552397568 00000100:00100000:2.0:1787853242.607104:0:15017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552397568 00000100:00100000:1.0:1787853242.607183:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552398080 00000100:00100000:2.0:1787853242.607289:0:15017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787853242.607299:0:15017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49092bd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874699552397568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787853242.607333:0:15017:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787853242.607384:0:15017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49092bd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874699552397568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (4306us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853242.607392:0:15017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1787853242.607418:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787853242.607434:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552398208 00000100:00100000:2.0:1787853242.607437:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552398208 00000100:00100000:2.0:1787853242.607471:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787853242.607478:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f492eb883c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874699552398208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853242.607513:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f492eb883c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874699552398208:12345-0@lo:400:kworker.0 Request processed in 36us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853242.607520:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:2.0:1787853242.607536:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787853242.607562:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f492eb88780 x1874699552398208/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787853258 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787853242.607612:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f492eb88780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1874699552398208:0@lo:400:kworker.0 00000100:00100000:2.0:1787853242.607648:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4934116d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552397568:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787853242.610921:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552398080 00000100:00100000:1.0:1787853242.611034:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787853242.611047:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f492eb88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874699552398080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853242.611181:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f492eb88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874699552398080:12345-0@lo:400:kworker.0 Request processed in 136us (4242us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853242.611190:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1787853242.612144:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f492eb8a580 x1874699552398080/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787853258 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787853242.612165:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f492eb8a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874699552398080:0@lo:400:kworker.0 00000100:00100000:3.0:1787853242.635158:0:15498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49092be940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3305:x1874699552397952:12345-0@lo:8:kworker.0 Request processed in 31608us (31918us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787853242.635190:0:15498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1787853242.635221:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8f4911cd3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787853242.635230:0:3305:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787853242.635489:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f492eb8a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1874699552397952:0@lo:8:kworker.0 00000020:01000004:1.0:1787853242.810298:0:15733:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787853242.810303:0:15733:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:1.0:1787853242.810441:0:15733:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8f480186a000 00000020:01000004:1.0:1787853242.810459:0:15733:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1787853242.810471:0:15733:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:1.0:1787853242.810486:0:15733:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8f493d11b3a0) 00000020:00000080:1.0:1787853242.810502:0:15733:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1787853242.826139:0:15733:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1787853242.826461:0:15733:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1787853242.827411:0:15733:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787853242.830368:0:15733:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1787853242.830991:0:15733:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1787853242.831444:0:15733:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 413: rc = 0 00100000:10000000:2.0:1787853242.831717:0:15733:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 413: rc = 0 00100000:10000000:2.0:1787853242.831884:0:15733:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 413: rc = 0 00100000:10000000:2.0:1787853242.832468:0:15733:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 374: rc = 0 00100000:10000000:2.0:1787853242.832890:0:15733:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 374: rc = 0 00100000:10000000:2.0:1787853242.833243:0:15733:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 374: rc = 0 00100000:10000000:2.0:1787853242.833496:0:15733:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 374: rc = 0 00100000:10000000:2.0:1787853242.837651:0:15733:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 374: rc = 0 00100000:10000000:2.0:1787853242.839763:0:15733:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 374: rc = 0 00000020:00000080:2.0:1787853242.841441:0:15733:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1787853242.841458:0:15733:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787853242.841473:0:15733:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x710df789068e7406 00000020:01000004:2.0:1787853242.841484:0:15733:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1787853242.841514:0:15733:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.101@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787853242.841519:0:15733:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.101@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787853242.841526:0:15733:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1787853242.841553:0:15733:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1787853242.841558:0:15733:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.101@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1787853242.851969:0:15733:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.101@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787853242.852005:0:15733:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.101@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1787853242.852009:0:15733:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787853242.852078:0:15733:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787853242.852080:0:15733:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787853242.852088:0:15733:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787853242.852089:0:15733:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787853242.852091:0:15733:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787853242.852092:0:15733:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787853242.852094:0:15733:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787853242.852095:0:15733:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787853242.852099:0:15733:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1787853242.852101:0:15733:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787853242.852102:0:15733:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787853242.852104:0:15733:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787853242.852105:0:15733:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787853242.852106:0:15733:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787853242.852107:0:15733:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787853242.852114:0:15733:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787853242.852115:0:15733:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787853242.852116:0:15733:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787853242.852146:0:15733:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787853242.852332:0:15733:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f492eb88780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a76e730b-0783-4789-a5e2-a4230bb4bd66:15733:1874699552398336:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787853242.852424:0:15733:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853242.852488:0:15733:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f493fd0a300 going to sleep for 11 seconds 00000100:00100000:1.0:1787853242.852633:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552398336 00000100:00100000:1.0:1787853242.852641:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552398336 00000100:00100000:1.0:1787853242.852702:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787853242.852712:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49053f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a76e730b-0783-4789-a5e2-a4230bb4bd66+16:15733:x1874699552398336:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787853242.852744:0:14324:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1787853242.852748:0:14324:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1787853242.852752:0:14324:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1787853242.866608:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49053f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a76e730b-0783-4789-a5e2-a4230bb4bd66+16:15733:x1874699552398336:12345-0@lo:253:mount.lustre.0 Request processed in 13887us (14173us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853242.866625:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787853242.866777:0:15733:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f492eb88780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a76e730b-0783-4789-a5e2-a4230bb4bd66:15733:1874699552398336:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787853242.866873:0:15733:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1787853242.866878:0:15733:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787853242.866880:0:15733:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787853242.866881:0:15733:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787853242.866882:0:15733:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787853242.866883:0:15733:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787853242.866885:0:15733:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787853242.866886:0:15733:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787853242.866888:0:15733:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787853242.866890:0:15733:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787853242.866997:0:15733:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8f480186a000 from lustre-OST0001 10000000:01000000:0.0:1787853242.867027:0:15733:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1787853242.867031:0:15733:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1787853242.867040:0:15733:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8f493ffe4d70 local copy 00010000:00010000:0.0:1787853242.867051:0:15733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f49415b6600/0x710df789068e71b3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e71ba expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853242.867427:0:15733:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49092be1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a76e730b-0783-4789-a5e2-a4230bb4bd66:15733:1874699552398464:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787853242.867469:0:15733:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853242.867556:0:15733:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f490633e780 going to sleep for 11 seconds 00000100:00100000:1.0:1787853242.867674:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552398464 00000100:00100000:1.0:1787853242.867681:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552398464 00000100:00100000:1.0:1787853242.867754:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787853242.867763:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49053f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a76e730b-0783-4789-a5e2-a4230bb4bd66+16:15733:x1874699552398464:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787853242.867925:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49053f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a76e730b-0783-4789-a5e2-a4230bb4bd66+16:15733:x1874699552398464:12345-0@lo:501:mount.lustre.0 Request processed in 163us (454us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787853242.867933:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787853242.867993:0:15733:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49092be1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a76e730b-0783-4789-a5e2-a4230bb4bd66:15733:1874699552398464:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1787853242.868008:0:15733:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.101@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787853242.868195:0:15733:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.101@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787853242.868202:0:15733:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f49415b6600/0x710df789068e71b3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e71ba expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853242.868212:0:15733:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: ffff8f49415b6600/0x710df789068e71b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e71ba expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787853242.868236:0:15733:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8f480186a000 10000000:01000000:2.0:1787853242.868241:0:15733:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787853242.868246:0:15733:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1787853242.868249:0:15733:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787853242.868253:0:15733:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1787853242.868257:0:15733:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1787853242.868285:0:15733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f4906503a00/0x710df789068e740d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853242.868293:0:15733:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.101@tcp lock: ffff8f4906503a00/0x710df789068e740d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853242.868317:0:15733:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: ffff8f4906503a00/0x710df789068e740d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853242.868332:0:15733:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f492eb89e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a76e730b-0783-4789-a5e2-a4230bb4bd66:15733:1874699552398592:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787853242.868363:0:15733:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853242.868763:0:15733:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f493fd0a0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787853242.868968:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552398592 00000100:00100000:0.0:1787853242.868975:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552398592 00000100:00100000:0.0:1787853242.869010:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787853242.869017:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49053f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a76e730b-0783-4789-a5e2-a4230bb4bd66+16:15733:x1874699552398592:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787853242.869029:0:14322:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853242.869043:0:14322:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f49415b7800/0x710df789068e7414 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x710df789068e740d expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853242.869079:0:14322:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f49415b7800/0x710df789068e7414 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x710df789068e740d expref: 17 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853242.869089:0:14322:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f49415b7800/0x710df789068e7414 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x710df789068e740d expref: 17 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853242.869099:0:14322:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49415b7800, rc 0) 00000100:00100000:0.0:1787853242.869426:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49053f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a76e730b-0783-4789-a5e2-a4230bb4bd66+17:15733:x1874699552398592:12345-0@lo:101:mount.lustre.0 Request processed in 407us (1060us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853242.869433:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787853242.870108:0:15733:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f492eb89e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a76e730b-0783-4789-a5e2-a4230bb4bd66:15733:1874699552398592:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787853242.870129:0:15733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: ffff8f4906503a00/0x710df789068e740d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e7414 expref: -99 pid: 15733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853242.870140:0:15733:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: ffff8f4906503a00/0x710df789068e740d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x710df789068e7414 expref: -99 pid: 15733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787853242.871709:0:15733:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1787853242.873097:0:15733:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787853242.873522:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1787853242.873623:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1787853242.873658:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1787853242.873703:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1787853242.873735:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1787853242.873763:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1787853242.874132:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1787853242.874143:0:15733:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1787853242.874364:0:15733:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f492eb89e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a76e730b-0783-4789-a5e2-a4230bb4bd66:15733:1874699552398720:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787853242.874433:0:15733:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853242.874532:0:15733:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f493fd0a240 going to sleep for 11 seconds 00000100:00100000:0.0:1787853242.874726:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552398720 00000100:00100000:0.0:1787853242.874734:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552398720 00000100:00100000:0.0:1787853242.874888:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787853242.874898:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493d129c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a76e730b-0783-4789-a5e2-a4230bb4bd66+17:15733:x1874699552398720:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787853242.875328:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493d129c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a76e730b-0783-4789-a5e2-a4230bb4bd66+17:15733:x1874699552398720:12345-0@lo:501:mount.lustre.0 Request processed in 430us (894us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853242.875336:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787853242.875594:0:15733:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f492eb89e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a76e730b-0783-4789-a5e2-a4230bb4bd66:15733:1874699552398720:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787853242.875642:0:15733:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f492eb89e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a76e730b-0783-4789-a5e2-a4230bb4bd66:15733:1874699552398848:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787853242.875680:0:15733:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853242.875714:0:15733:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f493fd0a240 going to sleep for 11 seconds 00000100:00100000:3.0:1787853242.875772:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552398848 00000100:00100000:3.0:1787853242.875778:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552398848 00000100:00100000:3.0:1787853242.875902:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787853242.875917:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493d12a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a76e730b-0783-4789-a5e2-a4230bb4bd66+17:15733:x1874699552398848:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787853242.876447:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493d12a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a76e730b-0783-4789-a5e2-a4230bb4bd66+17:15733:x1874699552398848:12345-0@lo:503:mount.lustre.0 Request processed in 530us (764us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853242.876454:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787853242.876600:0:15733:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f492eb89e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a76e730b-0783-4789-a5e2-a4230bb4bd66:15733:1874699552398848:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787853242.877435:0:15733:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787853242.877516:0:15733:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f492eb89e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a76e730b-0783-4789-a5e2-a4230bb4bd66:15733:1874699552398976:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787853242.877764:0:15733:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853242.877921:0:15733:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f493fd0a240 going to sleep for 11 seconds 00000100:00100000:1.0:1787853242.877971:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552398976 00000100:00100000:1.0:1787853242.877978:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552398976 00000100:00100000:1.0:1787853242.878072:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787853242.878081:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493d129450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a76e730b-0783-4789-a5e2-a4230bb4bd66+17:15733:x1874699552398976:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787853242.878371:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493d129450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a76e730b-0783-4789-a5e2-a4230bb4bd66+17:15733:x1874699552398976:12345-0@lo:502:mount.lustre.0 Request processed in 289us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853242.878380:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787853242.878470:0:15733:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f492eb89e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a76e730b-0783-4789-a5e2-a4230bb4bd66:15733:1874699552398976:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787853242.878768:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1787853242.878836:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1787853242.878873:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1787853242.878924:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1787853242.878964:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1787853242.878999:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1787853242.879048:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1787853242.879084:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1787853242.879131:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:2.0:1787853242.879350:0:15733:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f492eb89e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a76e730b-0783-4789-a5e2-a4230bb4bd66:15733:1874699552399104:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787853242.879410:0:15733:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853242.879627:0:15733:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f493fd0a240 going to sleep for 11 seconds 00000100:00100000:3.0:1787853242.879744:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552399104 00000100:00100000:3.0:1787853242.879752:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552399104 00000100:00100000:3.0:1787853242.879798:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787853242.879807:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493d128450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a76e730b-0783-4789-a5e2-a4230bb4bd66+17:15733:x1874699552399104:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787853242.880000:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493d128450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a76e730b-0783-4789-a5e2-a4230bb4bd66+17:15733:x1874699552399104:12345-0@lo:502:mount.lustre.0 Request processed in 193us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853242.880008:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787853242.880171:0:15733:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f492eb89e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a76e730b-0783-4789-a5e2-a4230bb4bd66:15733:1874699552399104:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787853242.880263:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:2.0:1787853242.880275:0:15733:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:2.0:1787853242.883078:0:15735:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787853242.883092:0:15735:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1787853242.883116:0:15735:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787853242.883118:0:15735:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1787853242.883127:0:15735:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787853242.883145:0:15735:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8f48011819d0) 00000020:00000080:2.0:1787853242.883235:0:15735:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:2.0:1787853242.883244:0:15735:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787853242.883324:0:15735:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f480186a000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1787853242.883333:0:15735:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787853242.883341:0:15735:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x710df789068e7422 00010000:00010000:2.0:1787853242.888332:0:15735:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:2.0:1787853242.888890:0:15735:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:2.0:1787853242.891912:0:15735:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:3.0:1787853242.893753:0:15735:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1787853242.893767:0:15735:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787853242.893774:0:15735:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787853242.893776:0:15735:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1787853242.893780:0:15735:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787853242.893797:0:15735:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787853242.893798:0:15735:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787853242.893802:0:15735:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787853242.893804:0:15735:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787853242.893807:0:15735:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787853242.893809:0:15735:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787853242.893810:0:15735:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:3.0:1787853242.893813:0:15735:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787853242.893815:0:15735:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787853242.893816:0:15735:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787853242.893819:0:15735:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1787853242.893879:0:15735:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787853242.893883:0:15735:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787853242.893884:0:15735:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787853242.893895:0:15735:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:2.0:1787853242.894154:0:15733:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1787853242.894189:0:15733:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.101@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1787853242.894210:0:15733:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f4906503a00/0x710df789068e740d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e7414 expref: -99 pid: 15733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853242.894223:0:15733:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: ffff8f4906503a00/0x710df789068e740d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e7414 expref: -99 pid: 15733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787853242.894234:0:15733:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f480186a000 from 1 10000000:01000000:2.0:1787853242.894238:0:15733:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787853242.894281:0:15733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f4906502c00/0x710df789068e7429 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853242.894290:0:15733:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.101@tcp lock: ffff8f4906502c00/0x710df789068e7429 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853242.894302:0:15733:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: ffff8f4906502c00/0x710df789068e7429 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853242.894328:0:15733:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f492eb89e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a76e730b-0783-4789-a5e2-a4230bb4bd66:15733:1874699552399232:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787853242.894414:0:15733:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853242.894470:0:15733:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f493fd0af00 going to sleep for 11 seconds 00000100:00100000:3.0:1787853242.894689:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552399232 00000100:00100000:3.0:1787853242.894698:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552399232 00000100:00100000:3.0:1787853242.894746:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787853242.894756:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493d12b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a76e730b-0783-4789-a5e2-a4230bb4bd66+17:15733:x1874699552399232:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787853242.894772:0:14324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853242.894901:0:14324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f4921e20600/0x710df789068e7430 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x710df789068e7429 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853242.894929:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f4921e20600/0x710df789068e7430 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x710df789068e7429 expref: 18 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853242.894941:0:14324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f4921e20600/0x710df789068e7430 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x710df789068e7429 expref: 18 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853242.894952:0:14324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4921e20600, rc 0) 00000100:00100000:3.0:1787853242.895005:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493d12b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a76e730b-0783-4789-a5e2-a4230bb4bd66+18:15733:x1874699552399232:12345-0@lo:101:mount.lustre.0 Request processed in 251us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853242.895013:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787853242.895116:0:15733:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f492eb89e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a76e730b-0783-4789-a5e2-a4230bb4bd66:15733:1874699552399232:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787853242.895133:0:15733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: ffff8f4906502c00/0x710df789068e7429 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e7430 expref: -99 pid: 15733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853242.895143:0:15733:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: ffff8f4906502c00/0x710df789068e7429 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x710df789068e7430 expref: -99 pid: 15733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787853242.896020:0:15733:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1787853242.896372:0:15733:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787853242.896660:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1787853242.896701:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1787853242.896759:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1787853242.896767:0:15733:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1787853242.897011:0:15733:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4803e65680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a76e730b-0783-4789-a5e2-a4230bb4bd66:15733:1874699552399360:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787853242.897068:0:15733:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853242.897147:0:15733:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f4910a81c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787853242.904146:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552399360 00000100:00100000:3.0:1787853242.904171:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552399360 00000100:00100000:3.0:1787853242.904229:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787853242.904239:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493ffc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a76e730b-0783-4789-a5e2-a4230bb4bd66+18:15733:x1874699552399360:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787853242.904605:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493ffc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a76e730b-0783-4789-a5e2-a4230bb4bd66+18:15733:x1874699552399360:12345-0@lo:501:mount.lustre.0 Request processed in 368us (7536us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853242.904613:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787853242.906154:0:15733:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4803e65680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a76e730b-0783-4789-a5e2-a4230bb4bd66:15733:1874699552399360:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787853242.906963:0:15733:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49092bcb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a76e730b-0783-4789-a5e2-a4230bb4bd66:15733:1874699552399488:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787853242.907042:0:15733:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853242.907088:0:15733:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f490633e900 going to sleep for 11 seconds 00000100:00100000:2.0:1787853242.907287:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552399488 00000100:00100000:2.0:1787853242.907294:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552399488 00000100:00100000:2.0:1787853242.907347:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787853242.907356:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f48019c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a76e730b-0783-4789-a5e2-a4230bb4bd66+18:15733:x1874699552399488:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787853242.907991:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f48019c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a76e730b-0783-4789-a5e2-a4230bb4bd66+18:15733:x1874699552399488:12345-0@lo:503:mount.lustre.0 Request processed in 632us (947us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853242.908000:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787853242.911395:0:15733:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49092bcb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a76e730b-0783-4789-a5e2-a4230bb4bd66:15733:1874699552399488:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787853242.912706:0:15733:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787853242.912868:0:15733:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49092bcb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a76e730b-0783-4789-a5e2-a4230bb4bd66:15733:1874699552399616:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787853242.912972:0:15733:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853242.913073:0:15733:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f490633e900 going to sleep for 11 seconds 00000100:00100000:2.0:1787853242.913897:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552399616 00000100:00100000:2.0:1787853242.913909:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552399616 00000100:00100000:2.0:1787853242.914003:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787853242.914015:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f48019ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a76e730b-0783-4789-a5e2-a4230bb4bd66+18:15733:x1874699552399616:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787853242.914325:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f48019ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a76e730b-0783-4789-a5e2-a4230bb4bd66+18:15733:x1874699552399616:12345-0@lo:502:mount.lustre.0 Request processed in 312us (1353us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853242.914333:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787853242.914433:0:15733:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49092bcb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a76e730b-0783-4789-a5e2-a4230bb4bd66:15733:1874699552399616:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787853242.915074:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1787853242.915143:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1787853242.915215:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1787853242.915255:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1787853242.915291:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1787853242.915344:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1787853242.915382:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1787853242.915416:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1787853242.915461:0:15733:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4803e65e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a76e730b-0783-4789-a5e2-a4230bb4bd66:15733:1874699552399744:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787853242.915529:0:15733:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853242.916010:0:15733:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f4910a81c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787853242.916085:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552399744 00000100:00100000:0.0:1787853242.916094:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552399744 00000100:00100000:0.0:1787853242.916526:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787853242.916535:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f48019cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a76e730b-0783-4789-a5e2-a4230bb4bd66+18:15733:x1874699552399744:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787853242.916989:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f48019cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a76e730b-0783-4789-a5e2-a4230bb4bd66+18:15733:x1874699552399744:12345-0@lo:502:mount.lustre.0 Request processed in 454us (1460us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853242.916998:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787853242.917281:0:15733:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4803e65e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a76e730b-0783-4789-a5e2-a4230bb4bd66:15733:1874699552399744:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787853242.917427:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1787853242.917448:0:15733:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1787853242.919060:0:15739:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787853242.919074:0:15739:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787853242.919077:0:15739:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787853242.919091:0:15739:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f480186a000 00000020:00000080:3.0:1787853242.919094:0:15739:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787853242.919102:0:15739:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787853242.919105:0:15739:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787853242.919106:0:15739:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787853242.919108:0:15739:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787853242.919111:0:15739:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787853242.919112:0:15739:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787853242.919115:0:15739:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f480186a000 00000020:00000080:3.0:1787853242.919118:0:15739:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787853242.919284:0:15739:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787853242.919289:0:15739:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787853242.919290:0:15739:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1787853242.919293:0:15739:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787853242.919296:0:15739:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787853242.919298:0:15739:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787853242.919301:0:15739:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8f480186a000 00000020:00000080:3.0:1787853242.919303:0:15739:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787853242.924071:0:15739:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787853242.924084:0:15739:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787853242.924086:0:15739:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1787853242.924091:0:15739:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1787853242.924320:0:15733:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1787853242.924346:0:15733:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787853242.924365:0:15733:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f4906502c00/0x710df789068e7429 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e7430 expref: -99 pid: 15733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853242.924377:0:15733:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: ffff8f4906502c00/0x710df789068e7429 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e7430 expref: -99 pid: 15733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787853242.924436:0:15733:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787853242.924440:0:15733:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8f480186a000 10000000:01000000:3.0:1787853242.924444:0:15733:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8f480186a000 10000000:01000000:3.0:1787853242.924456:0:15733:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787853242.924462:0:15733:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8f480186a000 from 1 10000000:01000000:3.0:1787853242.924465:0:15733:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787853242.924508:0:15733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f4921e21400/0x710df789068e7437 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853242.924517:0:15733:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.101@tcp lock: ffff8f4921e21400/0x710df789068e7437 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853242.924529:0:15733:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: ffff8f4921e21400/0x710df789068e7437 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853242.924553:0:15733:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49341143c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a76e730b-0783-4789-a5e2-a4230bb4bd66:15733:1874699552399872:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787853242.924661:0:15733:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853242.924710:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552399872 00000100:00100000:3.0:1787853242.924717:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552399872 00000100:00100000:3.0:1787853242.924757:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787853242.924766:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f48019cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a76e730b-0783-4789-a5e2-a4230bb4bd66+18:15733:x1874699552399872:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787853242.924780:0:14322:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853242.927295:0:14322:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f4921e21e00/0x710df789068e743e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x710df789068e7437 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853242.927349:0:14322:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f4921e21e00/0x710df789068e743e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x710df789068e7437 expref: 19 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853242.927363:0:14322:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f4921e21e00/0x710df789068e743e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x710df789068e7437 expref: 19 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853242.927373:0:14322:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4921e21e00, rc 0) 00000100:00100000:3.0:1787853242.927459:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f48019cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a76e730b-0783-4789-a5e2-a4230bb4bd66+19:15733:x1874699552399872:12345-0@lo:101:mount.lustre.0 Request processed in 2692us (2797us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853242.927477:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787853242.927606:0:15733:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f4911ecdd80 going to sleep for 11 seconds 00000100:00100000:3.0:1787853242.927637:0:15733:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49341143c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a76e730b-0783-4789-a5e2-a4230bb4bd66:15733:1874699552399872:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787853242.927657:0:15733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: ffff8f4921e21400/0x710df789068e7437 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e743e expref: -99 pid: 15733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853242.927669:0:15733:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: ffff8f4921e21400/0x710df789068e7437 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x710df789068e743e expref: -99 pid: 15733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787853242.934612:0:15733:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:3.0:1787853242.940328:0:15733:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787853242.940742:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1787853242.943312:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1787853242.943415:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1787853242.943492:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1787853242.943530:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1787853242.943623:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1787853242.943662:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1787853242.943697:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1787853242.943760:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1787853242.945074:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1787853242.945124:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1787853242.946388:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1787853242.946468:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1787853242.946505:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1787853242.946556:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1787853242.948088:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1787853242.948155:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1787853242.948598:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1787853242.948641:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1787853242.948687:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1787853242.948735:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1787853242.948773:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1787853242.949967:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1787853242.950052:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1787853242.950091:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1787853242.950126:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1787853242.950917:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1787853242.950972:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1787853242.951009:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1787853242.951058:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:2.0:1787853242.951094:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:2.0:1787853242.951131:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:2.0:1787853242.952054:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:2.0:1787853242.952128:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:2.0:1787853242.952691:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:2.0:1787853242.952761:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:2.0:1787853242.953260:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:2.0:1787853242.953367:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:2.0:1787853242.953376:0:15733:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:2.0:1787853242.954446:0:15733:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f492eb89e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a76e730b-0783-4789-a5e2-a4230bb4bd66:15733:1874699552400000:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787853242.954971:0:15733:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853242.955054:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552400000 00000100:00100000:2.0:1787853242.955056:0:15733:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f4912a69a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787853242.955075:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552400000 00000100:00100000:3.0:1787853242.955140:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787853242.955150:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f48019cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a76e730b-0783-4789-a5e2-a4230bb4bd66+19:15733:x1874699552400000:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787853242.955675:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f48019cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a76e730b-0783-4789-a5e2-a4230bb4bd66+19:15733:x1874699552400000:12345-0@lo:501:mount.lustre.0 Request processed in 525us (704us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853242.955683:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787853242.963170:0:15733:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f492eb89e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a76e730b-0783-4789-a5e2-a4230bb4bd66:15733:1874699552400000:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787853242.963243:0:15733:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f492eb89e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a76e730b-0783-4789-a5e2-a4230bb4bd66:15733:1874699552400128:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787853242.963337:0:15733:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853242.963391:0:15733:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f4912a69a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787853242.963528:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552400128 00000100:00100000:0.0:1787853242.963536:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552400128 00000100:00100000:0.0:1787853242.963623:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787853242.963633:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f48019ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a76e730b-0783-4789-a5e2-a4230bb4bd66+19:15733:x1874699552400128:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787853242.963920:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f48019ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a76e730b-0783-4789-a5e2-a4230bb4bd66+19:15733:x1874699552400128:12345-0@lo:503:mount.lustre.0 Request processed in 287us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853242.963929:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787853242.964037:0:15733:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f492eb89e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a76e730b-0783-4789-a5e2-a4230bb4bd66:15733:1874699552400128:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787853242.964756:0:15733:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787853242.964950:0:15733:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f492eb89e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a76e730b-0783-4789-a5e2-a4230bb4bd66:15733:1874699552400256:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787853242.965002:0:15733:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853242.965036:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552400256 00000100:00100000:2.0:1787853242.965042:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552400256 00000100:00100000:2.0:1787853242.965078:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787853242.965085:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f48019c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a76e730b-0783-4789-a5e2-a4230bb4bd66+19:15733:x1874699552400256:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787853242.965352:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f48019c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a76e730b-0783-4789-a5e2-a4230bb4bd66+19:15733:x1874699552400256:12345-0@lo:502:mount.lustre.0 Request processed in 266us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853242.965360:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787853242.965409:0:15733:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f4912a69a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787853242.965428:0:15733:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f492eb89e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a76e730b-0783-4789-a5e2-a4230bb4bd66:15733:1874699552400256:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787853242.965696:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1787853242.965746:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1787853242.965781:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1787853242.966126:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1787853242.967251:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1787853242.967362:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1787853242.967405:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1787853242.967468:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1787853242.967525:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1787853242.967600:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1787853242.967639:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1787853242.967685:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1787853242.967721:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1787853242.967755:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1787853242.968160:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1787853242.968281:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1787853242.968317:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1787853242.968370:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1787853242.968419:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1787853242.968452:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1787853242.968493:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1787853242.968524:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1787853242.968552:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1787853242.968748:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1787853242.968861:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1787853242.968903:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1787853242.968977:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1787853242.969018:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1787853242.969052:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1787853242.969099:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1787853242.969136:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1787853242.969504:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1787853242.969544:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1787853242.969657:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1787853242.969696:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1787853242.969744:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1787853242.969781:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1787853242.978989:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:2.0:1787853242.979120:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:2.0:1787853242.979271:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:2.0:1787853242.979340:0:15733:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f492eb89e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a76e730b-0783-4789-a5e2-a4230bb4bd66:15733:1874699552400384:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787853242.979437:0:15733:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853242.979531:0:15733:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f4912a69a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787853242.982664:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552400384 00000100:00100000:1.0:1787853242.982680:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552400384 00000100:00100000:1.0:1787853242.982745:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787853242.982756:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f48019c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a76e730b-0783-4789-a5e2-a4230bb4bd66+19:15733:x1874699552400384:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787853242.983063:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f48019c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a76e730b-0783-4789-a5e2-a4230bb4bd66+19:15733:x1874699552400384:12345-0@lo:502:mount.lustre.0 Request processed in 307us (3626us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853242.983070:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787853242.983476:0:15733:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f492eb89e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a76e730b-0783-4789-a5e2-a4230bb4bd66:15733:1874699552400384:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787853242.983643:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:2.0:1787853242.983659:0:15733:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1787853242.989058:0:15744:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1787853242.989080:0:15744:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8f493d118000) 00000020:00000080:1.0:1787853242.989104:0:15744:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:1.0:1787853242.989213:0:15744:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f480186a000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787853242.989217:0:15744:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f480186a000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787853242.989220:0:15744:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f480186a000 3 00010000:00080000:1.0:1787853242.989250:0:15744:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f4906312800@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.101@tcp at head 00010000:00010000:1.0:1787853242.990955:0:15744:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:1.0:1787853242.991173:0:15744:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1787853242.991222:0:15744:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787853242.991241:0:15744:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x710df789068e744c 00000100:00080000:1.0:1787853242.991257:0:15744:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787853242.991265:0:15744:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8f4906312800 using connection 192.168.204.101@tcp/0@lo 00000100:00100000:1.0:1787853242.991309:0:15744:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f4803e65e00 x1874699552400512/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787853242.991345:0:15744:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1787853242.991666:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4803e65e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1874699552400512:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787853242.991754:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853242.991995:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552400512 00000100:00100000:2.0:1787853242.992005:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552400512 00000100:00100000:2.0:1787853242.992044:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787853242.992053:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f492eb89e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3305:x1874699552400512:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787853242.992078:0:14330:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 562 last 0 00000020:00000080:2.0:1787853242.992115:0:14330:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x710df789068e7453 00000004:00100000:2.0:1787853242.992132:0:14330:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787853242.992175:0:14330:0:(import.c:65:import_set_state_nolock()) ffff8f494129b000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787853242.992235:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f492eb89e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874699552400512:12345-0@lo:38:llog_process_th.0 Request processed in 181us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853242.992243:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787853242.992295:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f4803e65e00 x1874699552400512/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787853252 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787853242.992307:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787853242.992316:0:3305:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1787853242.992324:0:3305:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787853242.992329:0:3305:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787853242.992332:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8f4906312800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787853242.992337:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4803e65e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1874699552400512:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1787853242.998093:0:15744:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:0.0:1787853242.998360:0:15733:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1787853242.998401:0:15733:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787853242.998430:0:15733:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f4921e21400/0x710df789068e7437 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e743e expref: -99 pid: 15733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853242.998445:0:15733:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: ffff8f4921e21400/0x710df789068e7437 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e743e expref: -99 pid: 15733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787853242.998507:0:15733:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787853242.998509:0:15733:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787853242.998511:0:15733:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787853242.998512:0:15733:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787853242.998518:0:15733:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787853242.998519:0:15733:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787853242.998522:0:15733:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787853242.998524:0:15733:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787853242.998525:0:15733:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787853242.998529:0:15733:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1787853242.998532:0:15733:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787853242.998533:0:15733:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787853242.998534:0:15733:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787853242.998535:0:15733:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787853242.998536:0:15733:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787853242.998536:0:15733:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787853242.998537:0:15733:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787853242.998538:0:15733:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787853242.998539:0:15733:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787853242.998599:0:15733:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1787853242.998627:0:15733:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49092bed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a76e730b-0783-4789-a5e2-a4230bb4bd66:15733:1874699552400640:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787853242.998714:0:15733:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853242.998756:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552400640 00000100:00100000:0.0:1787853242.998765:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552400640 00000100:00100000:0.0:1787853242.998902:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787853242.998913:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f48019c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a76e730b-0783-4789-a5e2-a4230bb4bd66+19:15733:x1874699552400640:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787853242.998949:0:14322:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1787853242.998972:0:14322:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1787853242.999532:0:15733:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f49062a3d80 going to sleep for 11 seconds 20000000:01000000:1.0:1787853243.056734:0:14322:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787853243.056750:0:14322:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1787853243.056776:0:14345:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787853243.056792:0:14345:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787853243.056820:0:14345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f492a8ad200/0x710df789068e745a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853243.056855:0:14345:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f49415b9400/0x710df789068e7334 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x710df789068e732d expref: 19 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853243.056864:0:14345:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f492a8ad200/0x710df789068e745a lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853243.056906:0:14345:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f49415b9400/0x710df789068e7334 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x710df789068e732d expref: 19 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853243.056920:0:14345:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f49415b9400/0x710df789068e7334 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x710df789068e732d expref: 19 pid: 14323 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853243.056936:0:14345:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4803e65e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14345:1874699552400768:0@lo:104: 00000100:00100000:1.0:1787853243.057004:0:14345:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853243.057051:0:14345:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f49063f7180 going to sleep for 11 seconds 00000100:00100000:1.0:1787853243.057082:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552400768 00000100:00100000:1.0:1787853243.057090:0:14313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552400768 00000100:00100000:1.0:1787853243.057141:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787853243.057151:0:14313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4803e65680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a76e730b-0783-4789-a5e2-a4230bb4bd66+3:14345:x1874699552400768:12345-0@lo:104: 00010000:00010000:1.0:1787853243.057176:0:14313:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.101@tcp lock: ffff8f49415b6400/0x710df789068e732d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x710df789068e7334 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853243.057228:0:14313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787853243.057234:0:14313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4803e65680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a76e730b-0783-4789-a5e2-a4230bb4bd66+3:14345:x1874699552400768:12345-0@lo:104: Request processed in 85us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853243.057242:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787853243.057281:0:14345:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4803e65e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14345:1874699552400768:0@lo:104: 00010000:00010000:1.0:1787853243.057312:0:14345:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f492a8ad200/0x710df789068e745a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853243.058605:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787853243.058617:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.101@tcp lock: ffff8f49415b6400/0x710df789068e732d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x710df789068e7334 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853243.058626:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b6400 already unused, calling callback (ffffffffc1b55c20) 10000000:00010000:3.0:1787853243.058630:0:14317:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.101@tcp lock: ffff8f49415b6400/0x710df789068e732d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x710df789068e7334 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853243.058640:0:14317:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.101@tcp lock: ffff8f49415b6400/0x710df789068e732d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x710df789068e7334 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787853243.058646:0:14317:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.101@tcp lock: ffff8f49415b6400/0x710df789068e732d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x710df789068e7334 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787853243.058651:0:14317:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787853243.058699:0:14317:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.101@tcp lock: ffff8f49415b6400/0x710df789068e732d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x710df789068e7334 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853243.058705:0:14317:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787853243.058726:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.101@tcp lock: ffff8f49415b6400/0x710df789068e732d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x710df789068e7334 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853243.058733:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.101@tcp lock: ffff8f49415b6400/0x710df789068e732d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x710df789068e7334 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853243.058753:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787853243.058755:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787853243.058766:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787853243.060746:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49341143c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a76e730b-0783-4789-a5e2-a4230bb4bd66:3306:1874699552400896:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787853243.060829:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853243.060992:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552400896 00000100:00100000:1.0:1787853243.061001:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552400896 00010000:00010000:1.0:1787853243.061032:0:14314:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f49415b9400/0x710df789068e7334 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x710df789068e732d expref: 20 pid: 14323 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853243.061071:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787853243.061080:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4934114b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a76e730b-0783-4789-a5e2-a4230bb4bd66+20:3306:x1874699552400896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787853243.061097:0:14314:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787853243.061102:0:14314:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f49415b9400/0x710df789068e7334 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x710df789068e732d expref: 20 pid: 14323 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853243.061113:0:14314:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f49415b9400/0x710df789068e7334 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x710df789068e732d expref: 20 pid: 14323 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853243.061132:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f49415b9400/0x710df789068e7334 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x710df789068e732d expref: 20 pid: 14323 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853243.061147:0:14314:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f492a8ad200/0x710df789068e745a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853243.061156:0:14314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f492a8ad200/0x710df789068e745a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787853243.061184:0:14314:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004694809s 00010000:00010000:1.0:1787853243.061189:0:14314:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f492a8ad200/0x710df789068e745a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853243.061196:0:14314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f492a8ad200/0x710df789068e745a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853243.061219:0:14314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f492a8ad200/0x710df789068e745a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853243.061226:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f492a8ad200/0x710df789068e745a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853243.061232:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f492a8ad200 already unused, calling callback (ffffffffc1528440) 00010000:00010000:1.0:1787853243.061236:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f492a8ad200/0x710df789068e745a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853243.061246:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f492a8ad200/0x710df789068e745a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853243.061265:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f492a8ad200/0x710df789068e745a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853243.061275:0:14314:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787853243.061330:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4934114b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a76e730b-0783-4789-a5e2-a4230bb4bd66+19:3306:x1874699552400896:12345-0@lo:103:ldlm_bl.0 Request processed in 251us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853243.061348:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1787853243.061373:0:14345:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f492a8ad200/0x710df789068e745a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853243.061381:0:14345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f492a8ad200/0x710df789068e745a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853243.061387:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f492a8ad200/0x710df789068e745a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853243.061422:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49341143c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a76e730b-0783-4789-a5e2-a4230bb4bd66:3306:1874699552400896:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787853243.073935:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f48019c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a76e730b-0783-4789-a5e2-a4230bb4bd66+18:15733:x1874699552400640:12345-0@lo:253:mount.lustre.0 Request processed in 75014us (75210us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853243.073949:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787853243.074067:0:15733:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49092bed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a76e730b-0783-4789-a5e2-a4230bb4bd66:15733:1874699552400640:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787853243.074082:0:15733:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1787853243.074085:0:15733:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787853243.074087:0:15733:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787853243.074088:0:15733:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787853243.074089:0:15733:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787853243.074091:0:15733:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787853243.074093:0:15733:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787853243.074094:0:15733:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787853243.074096:0:15733:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787853243.074113:0:15733:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787853243.074130:0:15733:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1787853243.082634:0:15733:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1787853243.082887:0:15733:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1787853243.083027:0:15733:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1787853243.083181:0:15733:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1787853243.083302:0:15733:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1787853243.083777:0:15733:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1787853243.085989:0:15733:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:0.0:1787853243.115521:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1787853243.161769:0:15733:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1787853243.161845:0:15733:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1787853243.161884:0:15733:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787853243.161942:0:15733:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.101@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787853243.161959:0:15733:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1787853243.161987:0:15733:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:2.0:1787853244.143926:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787853244.336717:0:14326:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787853244.336727:0:14326:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8f493c6e5000 from 8 10000000:01000000:0.0:1787853244.336732:0:14326:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787853244.336779:0:14326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f49415b7400/0x710df789068e7461 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853244.336791:0:14326:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.101@tcp lock: ffff8f49415b7400/0x710df789068e7461 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853244.336804:0:14326:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: ffff8f49415b7400/0x710df789068e7461 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853244.336832:0:14326:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49092bed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a76e730b-0783-4789-a5e2-a4230bb4bd66:14326:1874699552401024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787853244.336921:0:14326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853244.336974:0:14326:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f49062a3c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787853244.337948:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552401024 00000100:00100000:2.0:1787853244.337959:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552401024 00000100:00100000:2.0:1787853244.338013:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787853244.338022:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f48019c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a76e730b-0783-4789-a5e2-a4230bb4bd66+18:14326:x1874699552401024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787853244.338050:0:14324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853244.338066:0:14324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f4906503200/0x710df789068e7468 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x710df789068e7461 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853244.338094:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f4906503200/0x710df789068e7468 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x710df789068e7461 expref: 19 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853244.338107:0:14324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f4906503200/0x710df789068e7468 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x710df789068e7461 expref: 19 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853244.338117:0:14324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4906503200, rc 0) 00000100:00100000:2.0:1787853244.338198:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f48019c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a76e730b-0783-4789-a5e2-a4230bb4bd66+19:14326:x1874699552401024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 176us (1276us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853244.338206:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787853244.338305:0:14326:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49092bed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a76e730b-0783-4789-a5e2-a4230bb4bd66:14326:1874699552401024:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787853244.338321:0:14326:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: ffff8f49415b7400/0x710df789068e7461 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e7468 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853244.338331:0:14326:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: ffff8f49415b7400/0x710df789068e7461 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x710df789068e7468 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853244.338400:0:14326:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49341161c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a76e730b-0783-4789-a5e2-a4230bb4bd66:14326:1874699552401152:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787853244.338437:0:14326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853244.338472:0:14326:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f490633ec00 going to sleep for 11 seconds 00000100:00100000:2.0:1787853244.338948:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552401152 00000100:00100000:2.0:1787853244.338954:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552401152 00000100:00100000:2.0:1787853244.338986:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787853244.338994:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493dc1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a76e730b-0783-4789-a5e2-a4230bb4bd66+19:14326:x1874699552401152:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787853244.339013:0:14322:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787853244.339037:0:14322:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787853244.339040:0:14322:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1787853244.339146:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493dc1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a76e730b-0783-4789-a5e2-a4230bb4bd66+19:14326:x1874699552401152:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 141us (697us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853244.339153:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787853244.339195:0:14326:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49341161c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a76e730b-0783-4789-a5e2-a4230bb4bd66:14326:1874699552401152:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787853244.339674:0:14326:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787853244.339686:0:14326:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f49415b7400/0x710df789068e7461 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e7468 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853244.339696:0:14326:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: ffff8f49415b7400/0x710df789068e7461 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e7468 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787853244.650308:0:14361:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787853245.163313:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853246.186190:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853247.209787:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787853247.725136:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787853247.725163:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49341170c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552401280:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787853247.725243:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853247.725493:0:15017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552401280 00000100:00100000:3.0:1787853247.725502:0:15017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552401280 00000100:00100000:3.0:1787853247.725607:0:15017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787853247.725618:0:15017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4803e652c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874699552401280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787853247.725654:0:15017:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787853247.725700:0:15017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4803e652c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874699552401280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853247.725707:0:15017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787853247.725887:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49341170c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552401280:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787853247.726070:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787853248.238602:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787853248.239334:0:475:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787853248.239339:0:475:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787853248.239354:0:475:0:(import.c:65:import_set_state_nolock()) ffff8f4911cd3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787853248.239365:0:475:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 562 00000100:00080000:1.0:1787853248.239370:0:475:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1787853248.239378:0:475:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8f4911cd3800 using connection 192.168.204.101@tcp/0@lo 00000100:00100000:1.0:1787853248.239408:0:475:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f4803e67480 x1874699552401536/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787853248.239499:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4803e66d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874699552401664:0@lo:400:kworker.0 00000100:00100000:1.0:1787853248.239612:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853248.239696:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787853248.239704:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4803e67c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a76e730b-0783-4789-a5e2-a4230bb4bd66:3309:1874699552401408:0@lo:400:kworker.0 00000100:00100000:1.0:1787853248.239780:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853248.239816:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4803e67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1874699552401536:0@lo:8:kworker.0 00000100:00100000:1.0:1787853248.239848:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853248.239879:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4803e65e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1874699552401792:0@lo:400:kworker.0 00000100:00100000:1.0:1787853248.239909:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853248.239929:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787853248.239935:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4803e64f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1874699552401920:0@lo:400:kworker.0 00000100:00100000:1.0:1787853248.239961:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853248.240014:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552401664 00000100:00100000:1.0:1787853248.240023:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552401664 00000100:00100000:1.0:1787853248.240066:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552401792 00000100:00100000:1.0:1787853248.240070:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552401792 00000100:00100000:1.0:1787853248.240100:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552401920 00000100:00100000:1.0:1787853248.240103:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552401920 00000100:00100000:1.0:1787853248.240123:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787853248.240134:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4803e66580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874699552401664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853248.240194:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4803e66580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874699552401664:12345-0@lo:400:kworker.0 Request processed in 62us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853248.240201:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787853248.240222:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787853248.240228:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49056da940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874699552401792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853248.240260:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49056da940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874699552401792:12345-0@lo:400:kworker.0 Request processed in 32us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853248.240266:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787853248.240278:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787853248.240284:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49056d8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874699552401920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853248.240310:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49056d8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874699552401920:12345-0@lo:400:kworker.0 Request processed in 26us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853248.240315:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787853248.240333:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552401408 00000100:00100000:1.0:1787853248.240337:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552401408 00000100:00100000:1.0:1787853248.240369:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787853248.240375:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493dc1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a76e730b-0783-4789-a5e2-a4230bb4bd66+19:3309:x1874699552401408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853248.240404:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493dc1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a76e730b-0783-4789-a5e2-a4230bb4bd66+19:3309:x1874699552401408:12345-0@lo:400:kworker.0 Request processed in 29us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853248.240419:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787853248.240472:0:15015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552401536 00000100:00100000:1.0:1787853248.240476:0:15015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552401536 00000100:00100000:1.0:1787853248.240498:0:15015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787853248.240503:0:15015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4803e670c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3305:x1874699552401536:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1787853248.240526:0:15015:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 567 last 0 00000020:00000080:1.0:1787853248.240557:0:15015:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x710df789068e746f 00002000:00100000:1.0:1787853248.240606:0:15015:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8f4934781000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113954 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1787853248.240611:0:15015:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1787853248.240613:0:15015:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1787853248.240988:0:15015:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787853248.241018:0:15015:0:(import.c:65:import_set_state_nolock()) ffff8f4934783800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787853248.241066:0:15015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4803e670c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3305:x1874699552401536:12345-0@lo:8:kworker.0 Request processed in 562us (1217us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853248.241074:0:15015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1787853248.241107:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787853248.241148:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f4803e67480 x1874699552401536/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787853273 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787853248.241160:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787853248.241170:0:3305:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1787853248.241180:0:3305:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787853248.241186:0:3305:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1787853248.241190:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8f4911cd3800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787853248.241206:0:3305:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787853248.241213:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4803e67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1874699552401536:0@lo:8:kworker.0 00000004:00080000:1.0:1787853248.241240:0:14353:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787853248.241627:0:14353:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 567783056172ns, next at 0ns, rc = 0 00010000:00080000:1.0:1787853248.241694:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f4803e64f00 x1874699552401920/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787853264 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787853248.241707:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4803e64f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1874699552401920:0@lo:400:kworker.0 00010000:00080000:1.0:1787853248.241722:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f4803e65e00 x1874699552401792/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787853264 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787853248.241732:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4803e65e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1874699552401792:0@lo:400:kworker.0 00000100:00100000:1.0:1787853248.241765:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4803e67c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a76e730b-0783-4789-a5e2-a4230bb4bd66:3309:1874699552401408:0@lo:400:kworker.0 00010000:00080000:1.0:1787853248.241783:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f4803e66d00 x1874699552401664/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787853264 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787853248.241793:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4803e66d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874699552401664:0@lo:400:kworker.0 00000004:00080000:0.0:1787853248.243614:0:14354:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:0.0:1787853248.243655:0:14354:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49092bcf00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14354:1874699552402176:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1787853248.243752:0:14354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853248.243793:0:14354:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f48027e5c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787853248.243833:0:15016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552402176 00000100:00100000:0.0:1787853248.243842:0:15016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552402176 00000100:00100000:0.0:1787853248.243906:0:15016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787853248.243916:0:15016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49092bfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14354:x1874699552402176:12345-0@lo:5:osp-pre-1-0.0 00000100:00080000:1.0:1787853248.248235:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787853248.253097:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787853248.253129:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49092bda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874699552402048:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787853248.253205:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853248.253368:0:15017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552402048 00000100:00100000:1.0:1787853248.253377:0:15017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552402048 00000100:00100000:1.0:1787853248.253430:0:15017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787853248.253441:0:15017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49056d9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1874699552402048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787853248.254554:0:15017:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787853248.254746:0:15017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49056d9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1874699552402048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1304us (1537us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853248.254755:0:15017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1787853248.256792:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f49092bda40 x1874699552402048/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787853264 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787853248.256833:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49092bda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874699552402048:0@lo:13:osp-pre-1-0.0 00002000:00080000:1.0:1787853248.259815:0:15016:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1787853248.259825:0:15016:0:(ofd_dev.c:1643:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:1.0:1787853248.259837:0:15016:0:(ofd_dev.c:1494:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00002000:00010000:0.0:1787853248.283617:0:15016:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787853248.283631:0:15016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ca8e832/0x710df789068e7476 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853248.283650:0:15016:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=567s v=(0 0) 00010000:00010000:0.0:1787853248.283654:0:15016:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787853248.283661:0:15016:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ca8e832/0x710df789068e7476 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853248.283679:0:15016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005ca8e832/0x710df789068e7476 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853248.283688:0:15016:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ca8e832/0x710df789068e7476 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853248.283696:0:15016:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005ca8e832/0x710df789068e7476 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853248.283714:0:15016:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787853248.283728:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787853248.283735:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005ca8e832/0x710df789068e7476 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853248.283742:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b6400 already unused, calling callback (ffffffffc1528440) 00010000:00010000:0.0:1787853248.283746:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005ca8e832/0x710df789068e7476 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853248.283767:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005ca8e832/0x710df789068e7476 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853248.283786:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005ca8e832/0x710df789068e7476 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853248.283793:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005ca8e832/0x710df789068e7476 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853248.283813:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853248.283814:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853248.283816:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787853248.284288:0:15016:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787853248.284295:0:15016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004fdc8612/0x710df789068e747d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853248.284303:0:15016:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=567s v=(0 0) 00010000:00010000:0.0:1787853248.284307:0:15016:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787853248.284312:0:15016:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004fdc8612/0x710df789068e747d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853248.284321:0:15016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004fdc8612/0x710df789068e747d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853248.284329:0:15016:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004fdc8612/0x710df789068e747d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853248.284343:0:15016:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004fdc8612/0x710df789068e747d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853248.284360:0:15016:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787853248.284371:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787853248.284375:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004fdc8612/0x710df789068e747d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853248.284384:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b7200 already unused, calling callback (ffffffffc1528440) 00010000:00010000:0.0:1787853248.284387:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004fdc8612/0x710df789068e747d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853248.284396:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004fdc8612/0x710df789068e747d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853248.284407:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004fdc8612/0x710df789068e747d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853248.284415:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004fdc8612/0x710df789068e747d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853248.284432:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853248.284433:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853248.284435:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787853248.284877:0:15016:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787853248.284890:0:15016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9ec9778/0x710df789068e7484 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853248.284901:0:15016:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=567s v=(0 0) 00010000:00010000:0.0:1787853248.284904:0:15016:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787853248.284908:0:15016:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9ec9778/0x710df789068e7484 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853248.284919:0:15016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9ec9778/0x710df789068e7484 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853248.284927:0:15016:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9ec9778/0x710df789068e7484 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853248.284934:0:15016:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e9ec9778/0x710df789068e7484 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853248.284948:0:15016:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787853248.284957:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787853248.284961:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e9ec9778/0x710df789068e7484 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853248.284968:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b6c00 already unused, calling callback (ffffffffc1528440) 00010000:00010000:0.0:1787853248.284971:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9ec9778/0x710df789068e7484 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853248.284979:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9ec9778/0x710df789068e7484 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853248.284996:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e9ec9778/0x710df789068e7484 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853248.285004:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9ec9778/0x710df789068e7484 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853248.285020:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853248.285022:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853248.285024:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787853248.285439:0:15016:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787853248.285446:0:15016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c611a504/0x710df789068e748b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853248.285467:0:15016:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=567s v=(0 0) 00010000:00010000:0.0:1787853248.285471:0:15016:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787853248.285475:0:15016:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c611a504/0x710df789068e748b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853248.285485:0:15016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c611a504/0x710df789068e748b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853248.285493:0:15016:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c611a504/0x710df789068e748b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853248.285502:0:15016:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c611a504/0x710df789068e748b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853248.285528:0:15016:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787853248.285539:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787853248.285544:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c611a504/0x710df789068e748b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853248.285551:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b6800 already unused, calling callback (ffffffffc1528440) 00010000:00010000:0.0:1787853248.285555:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c611a504/0x710df789068e748b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853248.285563:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c611a504/0x710df789068e748b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853248.285605:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c611a504/0x710df789068e748b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853248.285613:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c611a504/0x710df789068e748b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853248.285630:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853248.285632:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853248.285633:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787853248.295635:0:15016:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787853248.295647:0:15016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e612005/0x710df789068e7492 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853248.295663:0:15016:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=567s v=(0 0) 00010000:00010000:0.0:1787853248.295673:0:15016:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787853248.295681:0:15016:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e612005/0x710df789068e7492 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853248.295695:0:15016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e612005/0x710df789068e7492 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853248.295704:0:15016:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e612005/0x710df789068e7492 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853248.295711:0:15016:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e612005/0x710df789068e7492 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853248.295725:0:15016:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787853248.295737:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787853248.295742:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e612005/0x710df789068e7492 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853248.295749:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b6000 already unused, calling callback (ffffffffc1528440) 00010000:00010000:0.0:1787853248.295753:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e612005/0x710df789068e7492 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853248.295760:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e612005/0x710df789068e7492 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853248.295776:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e612005/0x710df789068e7492 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853248.295792:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e612005/0x710df789068e7492 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853248.295811:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853248.295813:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853248.295815:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787853248.296196:0:15016:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787853248.296202:0:15016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f13ef599/0x710df789068e7499 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853248.296211:0:15016:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=567s v=(0 0) 00010000:00010000:0.0:1787853248.296214:0:15016:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787853248.296218:0:15016:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f13ef599/0x710df789068e7499 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853248.296227:0:15016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f13ef599/0x710df789068e7499 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853248.296234:0:15016:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f13ef599/0x710df789068e7499 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853248.296241:0:15016:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f13ef599/0x710df789068e7499 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853248.296257:0:15016:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787853248.296266:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787853248.296275:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f13ef599/0x710df789068e7499 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853248.296283:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b6e00 already unused, calling callback (ffffffffc1528440) 00010000:00010000:0.0:1787853248.296286:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f13ef599/0x710df789068e7499 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853248.296294:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f13ef599/0x710df789068e7499 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853248.296305:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f13ef599/0x710df789068e7499 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853248.296312:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f13ef599/0x710df789068e7499 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853248.296325:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853248.296327:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853248.296329:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787853248.296732:0:15016:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787853248.296738:0:15016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000097b021a6/0x710df789068e74a0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853248.296747:0:15016:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=567s v=(0 0) 00010000:00010000:0.0:1787853248.296749:0:15016:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787853248.296754:0:15016:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000097b021a6/0x710df789068e74a0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853248.296773:0:15016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000097b021a6/0x710df789068e74a0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853248.296781:0:15016:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000097b021a6/0x710df789068e74a0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853248.296788:0:15016:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000097b021a6/0x710df789068e74a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853248.296800:0:15016:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787853248.296808:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787853248.296812:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000097b021a6/0x710df789068e74a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853248.296819:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b9400 already unused, calling callback (ffffffffc1528440) 00010000:00010000:0.0:1787853248.296823:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000097b021a6/0x710df789068e74a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853248.296830:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000097b021a6/0x710df789068e74a0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853248.296839:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000097b021a6/0x710df789068e74a0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853248.296846:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000097b021a6/0x710df789068e74a0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853248.296864:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853248.296866:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853248.296868:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787853248.297241:0:15016:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787853248.297247:0:15016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a3448dd/0x710df789068e74a7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853248.297255:0:15016:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=567s v=(0 0) 00010000:00010000:0.0:1787853248.297258:0:15016:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787853248.297263:0:15016:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005a3448dd/0x710df789068e74a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853248.297273:0:15016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005a3448dd/0x710df789068e74a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853248.297281:0:15016:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a3448dd/0x710df789068e74a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853248.297287:0:15016:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005a3448dd/0x710df789068e74a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853248.297300:0:15016:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787853248.297309:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787853248.297313:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005a3448dd/0x710df789068e74a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853248.297330:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b8600 already unused, calling callback (ffffffffc1528440) 00010000:00010000:0.0:1787853248.297333:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005a3448dd/0x710df789068e74a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853248.297341:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005a3448dd/0x710df789068e74a7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853248.297351:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005a3448dd/0x710df789068e74a7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853248.297357:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005a3448dd/0x710df789068e74a7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853248.297371:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853248.297373:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853248.297374:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787853248.310056:0:15016:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787853248.312684:0:15016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000854d8157/0x710df789068e74ae lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853248.312708:0:15016:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=567s v=(0 0) 00010000:00010000:0.0:1787853248.312714:0:15016:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787853248.312724:0:15016:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000854d8157/0x710df789068e74ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853248.312742:0:15016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000854d8157/0x710df789068e74ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853248.312776:0:15016:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000854d8157/0x710df789068e74ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853248.312784:0:15016:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000854d8157/0x710df789068e74ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853248.312807:0:15016:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787853248.312831:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787853248.312837:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000854d8157/0x710df789068e74ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853248.312845:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b8000 already unused, calling callback (ffffffffc1528440) 00010000:00010000:0.0:1787853248.312850:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000854d8157/0x710df789068e74ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853248.312858:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000854d8157/0x710df789068e74ae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853248.312875:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000854d8157/0x710df789068e74ae lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853248.312883:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000854d8157/0x710df789068e74ae lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853248.312908:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853248.312919:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853248.312921:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787853248.318119:0:15016:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787853248.318136:0:15016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003cccac84/0x710df789068e74b5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853248.318155:0:15016:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=567s v=(0 0) 00010000:00010000:0.0:1787853248.318160:0:15016:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787853248.318168:0:15016:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003cccac84/0x710df789068e74b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853248.318183:0:15016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003cccac84/0x710df789068e74b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853248.318197:0:15016:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003cccac84/0x710df789068e74b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853248.318204:0:15016:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003cccac84/0x710df789068e74b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853248.318227:0:15016:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787853248.318242:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787853248.318248:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003cccac84/0x710df789068e74b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853248.318255:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b8a00 already unused, calling callback (ffffffffc1528440) 00010000:00010000:0.0:1787853248.318260:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003cccac84/0x710df789068e74b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853248.318282:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003cccac84/0x710df789068e74b5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853248.318299:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003cccac84/0x710df789068e74b5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853248.318307:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003cccac84/0x710df789068e74b5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853248.318325:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853248.318327:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853248.318328:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787853248.333009:0:15016:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787853248.333024:0:15016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a273a774/0x710df789068e74bc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853248.333042:0:15016:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=567s v=(0 0) 00010000:00010000:0.0:1787853248.333046:0:15016:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787853248.333053:0:15016:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a273a774/0x710df789068e74bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853248.335873:0:15016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a273a774/0x710df789068e74bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853248.335900:0:15016:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a273a774/0x710df789068e74bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853248.335929:0:15016:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a273a774/0x710df789068e74bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853248.335949:0:15016:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787853248.335965:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787853248.335970:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a273a774/0x710df789068e74bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853248.335978:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b9000 already unused, calling callback (ffffffffc1528440) 00010000:00010000:0.0:1787853248.335983:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a273a774/0x710df789068e74bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853248.335992:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a273a774/0x710df789068e74bc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853248.336013:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a273a774/0x710df789068e74bc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853248.336020:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a273a774/0x710df789068e74bc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853248.336039:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853248.336041:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853248.336043:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787853248.352222:0:15016:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787853248.352238:0:15016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d3cf3c0/0x710df789068e74c3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853248.352256:0:15016:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=567s v=(0 0) 00010000:00010000:1.0:1787853248.352261:0:15016:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787853248.352268:0:15016:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009d3cf3c0/0x710df789068e74c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853248.352285:0:15016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009d3cf3c0/0x710df789068e74c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853248.352295:0:15016:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d3cf3c0/0x710df789068e74c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853248.352303:0:15016:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009d3cf3c0/0x710df789068e74c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853248.352323:0:15016:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787853248.352336:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787853248.352341:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009d3cf3c0/0x710df789068e74c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853248.352361:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f492a8ace00 already unused, calling callback (ffffffffc1528440) 00010000:00010000:1.0:1787853248.352365:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009d3cf3c0/0x710df789068e74c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853248.352373:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009d3cf3c0/0x710df789068e74c3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853248.352391:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009d3cf3c0/0x710df789068e74c3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853248.352398:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009d3cf3c0/0x710df789068e74c3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853248.352415:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853248.352416:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853248.352418:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787853248.353277:0:15016:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787853248.353285:0:15016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e779252/0x710df789068e74ca lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853248.353295:0:15016:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=567s v=(0 0) 00010000:00010000:1.0:1787853248.353299:0:15016:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787853248.353303:0:15016:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e779252/0x710df789068e74ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853248.353313:0:15016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e779252/0x710df789068e74ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853248.353330:0:15016:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e779252/0x710df789068e74ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853248.353336:0:15016:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e779252/0x710df789068e74ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853248.353352:0:15016:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787853248.353364:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787853248.353369:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e779252/0x710df789068e74ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853248.353375:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f492a8ac800 already unused, calling callback (ffffffffc1528440) 00010000:00010000:1.0:1787853248.353379:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e779252/0x710df789068e74ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853248.353386:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e779252/0x710df789068e74ca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853248.353396:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e779252/0x710df789068e74ca lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853248.353403:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e779252/0x710df789068e74ca lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853248.353417:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853248.353425:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853248.353427:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787853248.363524:0:15016:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787853248.363542:0:15016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce97a6aa/0x710df789068e74d1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853248.363562:0:15016:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=567s v=(0 0) 00010000:00010000:1.0:1787853248.363582:0:15016:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787853248.363590:0:15016:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce97a6aa/0x710df789068e74d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853248.363610:0:15016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ce97a6aa/0x710df789068e74d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853248.363622:0:15016:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce97a6aa/0x710df789068e74d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853248.363629:0:15016:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ce97a6aa/0x710df789068e74d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853248.363651:0:15016:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787853248.363671:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787853248.363677:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ce97a6aa/0x710df789068e74d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853248.363685:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f492a8adc00 already unused, calling callback (ffffffffc1528440) 00010000:00010000:1.0:1787853248.363689:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce97a6aa/0x710df789068e74d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853248.363717:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce97a6aa/0x710df789068e74d1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853248.363735:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ce97a6aa/0x710df789068e74d1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853248.363743:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ce97a6aa/0x710df789068e74d1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853248.363767:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853248.363769:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853248.363771:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1787853248.367027:0:5858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:1.0:1787853248.369427:0:15016:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787853248.369441:0:15016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e779252/0x710df789068e74d8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853248.369567:0:15016:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=567s v=(0 0) 00010000:00010000:1.0:1787853248.369595:0:15016:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787853248.369603:0:15016:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e779252/0x710df789068e74d8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853248.369619:0:15016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e779252/0x710df789068e74d8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853248.369629:0:15016:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e779252/0x710df789068e74d8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853248.369644:0:15016:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e779252/0x710df789068e74d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853248.369664:0:15016:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787853248.369677:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787853248.369684:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e779252/0x710df789068e74d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853248.369691:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f492a8ac800 already unused, calling callback (ffffffffc1528440) 00010000:00010000:1.0:1787853248.369696:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e779252/0x710df789068e74d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853248.369705:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e779252/0x710df789068e74d8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853248.369722:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e779252/0x710df789068e74d8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853248.369729:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e779252/0x710df789068e74d8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853248.369746:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853248.369748:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853248.369750:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787853248.372974:0:15016:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787853248.372996:0:15016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d3cf3c0/0x710df789068e74df lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853248.373014:0:15016:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=567s v=(0 0) 00010000:00010000:1.0:1787853248.373018:0:15016:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787853248.373025:0:15016:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009d3cf3c0/0x710df789068e74df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853248.373039:0:15016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009d3cf3c0/0x710df789068e74df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853248.373048:0:15016:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d3cf3c0/0x710df789068e74df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853248.373068:0:15016:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009d3cf3c0/0x710df789068e74df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853248.373085:0:15016:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787853248.373096:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787853248.373101:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009d3cf3c0/0x710df789068e74df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853248.373109:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f492a8ace00 already unused, calling callback (ffffffffc1528440) 00010000:00010000:1.0:1787853248.373113:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009d3cf3c0/0x710df789068e74df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853248.373123:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009d3cf3c0/0x710df789068e74df lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853248.373147:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009d3cf3c0/0x710df789068e74df lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853248.373154:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009d3cf3c0/0x710df789068e74df lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853248.373172:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853248.373174:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853248.373176:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787853248.373740:0:15016:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787853248.373746:0:15016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008a65dba6/0x710df789068e74e6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853248.373756:0:15016:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=567s v=(0 0) 00010000:00010000:1.0:1787853248.373759:0:15016:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787853248.373764:0:15016:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008a65dba6/0x710df789068e74e6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853248.373789:0:15016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008a65dba6/0x710df789068e74e6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853248.373798:0:15016:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008a65dba6/0x710df789068e74e6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853248.373804:0:15016:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008a65dba6/0x710df789068e74e6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853248.373830:0:15016:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787853248.373840:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787853248.373844:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008a65dba6/0x710df789068e74e6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853248.373851:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f492a8ac200 already unused, calling callback (ffffffffc1528440) 00010000:00010000:1.0:1787853248.373854:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008a65dba6/0x710df789068e74e6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853248.373863:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008a65dba6/0x710df789068e74e6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853248.373874:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008a65dba6/0x710df789068e74e6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853248.373881:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008a65dba6/0x710df789068e74e6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853248.373894:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853248.373896:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853248.373898:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787853248.374405:0:7641:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00010000:1.0:1787853248.379182:0:15016:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787853248.379198:0:15016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000015e222ed/0x710df789068e74ed lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853248.379214:0:15016:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=567s v=(0 0) 00010000:00010000:1.0:1787853248.379226:0:15016:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787853248.379233:0:15016:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000015e222ed/0x710df789068e74ed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853248.379249:0:15016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000015e222ed/0x710df789068e74ed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853248.379260:0:15016:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000015e222ed/0x710df789068e74ed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853248.379267:0:15016:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000015e222ed/0x710df789068e74ed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853248.379340:0:15016:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787853248.379855:0:15016:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787853248.379862:0:15016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067119fcb/0x710df789068e74f4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853248.379871:0:15016:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=567s v=(0 0) 00010000:00010000:1.0:1787853248.379875:0:15016:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787853248.379879:0:15016:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000067119fcb/0x710df789068e74f4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853248.379888:0:15016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000067119fcb/0x710df789068e74f4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853248.379896:0:15016:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067119fcb/0x710df789068e74f4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853248.379908:0:15016:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000067119fcb/0x710df789068e74f4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853248.382048:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787853248.382129:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000015e222ed/0x710df789068e74ed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853248.382144:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f492a8ac600 already unused, calling callback (ffffffffc1528440) 00010000:00010000:3.0:1787853248.382149:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000015e222ed/0x710df789068e74ed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853248.382161:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000015e222ed/0x710df789068e74ed lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853248.382189:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000015e222ed/0x710df789068e74ed lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853248.382198:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000015e222ed/0x710df789068e74ed lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853248.382225:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787853248.382229:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000067119fcb/0x710df789068e74f4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853248.382236:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f492a8aca00 already unused, calling callback (ffffffffc1528440) 00010000:00010000:3.0:1787853248.382239:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000067119fcb/0x710df789068e74f4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853248.382247:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000067119fcb/0x710df789068e74f4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853248.382271:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000067119fcb/0x710df789068e74f4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853248.382280:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787853248.382282:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787853248.382284:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853248.383244:0:15016:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787853248.383254:0:15016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000067119fcb/0x710df789068e74f4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787853248.383938:0:15016:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787853248.383946:0:15016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e779252/0x710df789068e74fb lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853248.383959:0:15016:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=567s v=(0 0) 00010000:00010000:1.0:1787853248.383963:0:15016:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787853248.383970:0:15016:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e779252/0x710df789068e74fb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853248.383982:0:15016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e779252/0x710df789068e74fb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853248.383992:0:15016:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e779252/0x710df789068e74fb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853248.383999:0:15016:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e779252/0x710df789068e74fb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853248.386703:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787853248.386717:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e779252/0x710df789068e74fb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853248.386730:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f492a8ac800 already unused, calling callback (ffffffffc1528440) 00010000:00010000:0.0:1787853248.386734:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e779252/0x710df789068e74fb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853248.386745:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e779252/0x710df789068e74fb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853248.386764:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e779252/0x710df789068e74fb lrc: 2/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853248.388132:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853248.388136:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853248.388140:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853248.391237:0:15016:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787853248.391254:0:15016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e779252/0x710df789068e74fb lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787853248.394823:0:15016:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787853248.394838:0:15016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce97a6aa/0x710df789068e7502 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853248.394855:0:15016:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=567s v=(0 0) 00010000:00010000:1.0:1787853248.394860:0:15016:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787853248.394867:0:15016:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce97a6aa/0x710df789068e7502 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853248.394881:0:15016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ce97a6aa/0x710df789068e7502 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853248.394892:0:15016:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce97a6aa/0x710df789068e7502 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853248.394900:0:15016:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ce97a6aa/0x710df789068e7502 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853248.398958:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787853248.398977:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ce97a6aa/0x710df789068e7502 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853248.398991:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f492a8adc00 already unused, calling callback (ffffffffc1528440) 00010000:00010000:3.0:1787853248.398996:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce97a6aa/0x710df789068e7502 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853248.399007:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce97a6aa/0x710df789068e7502 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853248.399031:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ce97a6aa/0x710df789068e7502 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853248.399044:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787853248.399046:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787853248.399048:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853248.403694:0:15016:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787853248.403711:0:15016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ce97a6aa/0x710df789068e7502 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853248.404152:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787853248.410323:0:15016:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787853248.410338:0:15016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d42846e1/0x710df789068e7509 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853248.410357:0:15016:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=567s v=(0 0) 00010000:00010000:1.0:1787853248.410363:0:15016:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787853248.410369:0:15016:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d42846e1/0x710df789068e7509 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853248.410384:0:15016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d42846e1/0x710df789068e7509 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853248.410394:0:15016:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d42846e1/0x710df789068e7509 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853248.410402:0:15016:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d42846e1/0x710df789068e7509 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853248.410423:0:15016:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787853248.410582:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787853248.410592:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d42846e1/0x710df789068e7509 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853248.410613:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f492a8acc00 already unused, calling callback (ffffffffc1528440) 00010000:00010000:3.0:1787853248.410618:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d42846e1/0x710df789068e7509 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853248.410626:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d42846e1/0x710df789068e7509 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853248.410643:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d42846e1/0x710df789068e7509 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853248.410650:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d42846e1/0x710df789068e7509 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853248.410672:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787853248.410674:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787853248.410675:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787853248.416823:0:15016:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787853248.416837:0:15016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e07b8dd/0x710df789068e7510 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853248.416855:0:15016:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=567s v=(0 0) 00010000:00010000:1.0:1787853248.416860:0:15016:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787853248.416874:0:15016:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003e07b8dd/0x710df789068e7510 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853248.416889:0:15016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003e07b8dd/0x710df789068e7510 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853248.416898:0:15016:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e07b8dd/0x710df789068e7510 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853248.416904:0:15016:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003e07b8dd/0x710df789068e7510 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853248.416929:0:15016:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787853248.417176:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787853248.417191:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003e07b8dd/0x710df789068e7510 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853248.417201:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f492a8ada00 already unused, calling callback (ffffffffc1528440) 00010000:00010000:0.0:1787853248.417205:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003e07b8dd/0x710df789068e7510 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853248.417215:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003e07b8dd/0x710df789068e7510 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853248.417244:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003e07b8dd/0x710df789068e7510 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853248.417252:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003e07b8dd/0x710df789068e7510 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853248.417271:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853248.417273:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853248.417274:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787853248.422939:0:15016:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787853248.422953:0:15016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000095a932e7/0x710df789068e7517 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853248.422973:0:15016:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=567s v=(0 0) 00010000:00010000:1.0:1787853248.422977:0:15016:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787853248.422984:0:15016:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000095a932e7/0x710df789068e7517 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853248.422998:0:15016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000095a932e7/0x710df789068e7517 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853248.423008:0:15016:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000095a932e7/0x710df789068e7517 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853248.423026:0:15016:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000095a932e7/0x710df789068e7517 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853248.423047:0:15016:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787853248.423278:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787853248.423286:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000095a932e7/0x710df789068e7517 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853248.423294:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f492a8ac400 already unused, calling callback (ffffffffc1528440) 00010000:00010000:1.0:1787853248.423299:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000095a932e7/0x710df789068e7517 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853248.423309:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000095a932e7/0x710df789068e7517 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853248.423327:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000095a932e7/0x710df789068e7517 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853248.423335:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000095a932e7/0x710df789068e7517 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853248.423356:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853248.423358:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853248.423360:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787853248.423852:0:15016:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787853248.423864:0:15016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a661bcb/0x710df789068e751e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853248.423874:0:15016:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=567s v=(0 0) 00010000:00010000:1.0:1787853248.423878:0:15016:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787853248.423883:0:15016:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003a661bcb/0x710df789068e751e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853248.423894:0:15016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003a661bcb/0x710df789068e751e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853248.423903:0:15016:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a661bcb/0x710df789068e751e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853248.423911:0:15016:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003a661bcb/0x710df789068e751e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853248.423927:0:15016:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787853248.423936:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787853248.423940:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003a661bcb/0x710df789068e751e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853248.423947:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f492a8ade00 already unused, calling callback (ffffffffc1528440) 00010000:00010000:1.0:1787853248.423950:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003a661bcb/0x710df789068e751e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853248.423959:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003a661bcb/0x710df789068e751e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853248.423974:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003a661bcb/0x710df789068e751e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853248.423981:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003a661bcb/0x710df789068e751e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853248.423994:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853248.423996:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853248.423998:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787853248.424955:0:15016:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787853248.424963:0:15016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d3cf3c0/0x710df789068e7525 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853248.424973:0:15016:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=567s v=(0 0) 00010000:00010000:1.0:1787853248.424976:0:15016:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787853248.424980:0:15016:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009d3cf3c0/0x710df789068e7525 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853248.424990:0:15016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009d3cf3c0/0x710df789068e7525 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853248.424998:0:15016:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d3cf3c0/0x710df789068e7525 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853248.425004:0:15016:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009d3cf3c0/0x710df789068e7525 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853248.425299:0:15016:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787853248.425759:0:15016:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787853248.425765:0:15016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090de6db0/0x710df789068e752c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853248.425789:0:15016:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=567s v=(0 0) 00010000:00010000:1.0:1787853248.425792:0:15016:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787853248.425797:0:15016:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000090de6db0/0x710df789068e752c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853248.425807:0:15016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000090de6db0/0x710df789068e752c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853248.425815:0:15016:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090de6db0/0x710df789068e752c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853248.425822:0:15016:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000090de6db0/0x710df789068e752c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853248.428521:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787853248.428534:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009d3cf3c0/0x710df789068e7525 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853248.428547:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f492a8ace00 already unused, calling callback (ffffffffc1528440) 00010000:00010000:3.0:1787853248.428552:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009d3cf3c0/0x710df789068e7525 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853248.428562:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009d3cf3c0/0x710df789068e7525 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853248.428618:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009d3cf3c0/0x710df789068e7525 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853248.428626:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009d3cf3c0/0x710df789068e7525 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853248.428651:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787853248.428655:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000090de6db0/0x710df789068e752c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853248.428662:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f492a8ad200 already unused, calling callback (ffffffffc1528440) 00010000:00010000:3.0:1787853248.428665:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000090de6db0/0x710df789068e752c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853248.428671:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000090de6db0/0x710df789068e752c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853248.428679:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000090de6db0/0x710df789068e752c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853248.428685:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787853248.428687:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787853248.428688:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853248.430499:0:15016:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787853248.430512:0:15016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000090de6db0/0x710df789068e752c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787853248.431198:0:15016:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787853248.431206:0:15016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a355fbb2/0x710df789068e7533 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853248.431225:0:15016:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=567s v=(0 0) 00010000:00010000:1.0:1787853248.431229:0:15016:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787853248.431235:0:15016:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a355fbb2/0x710df789068e7533 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853248.431248:0:15016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a355fbb2/0x710df789068e7533 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853248.431259:0:15016:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a355fbb2/0x710df789068e7533 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853248.431265:0:15016:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a355fbb2/0x710df789068e7533 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853248.436332:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787853248.436349:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a355fbb2/0x710df789068e7533 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853248.436365:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4900030e00 already unused, calling callback (ffffffffc1528440) 00010000:00010000:2.0:1787853248.436370:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a355fbb2/0x710df789068e7533 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853248.436383:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a355fbb2/0x710df789068e7533 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853248.436413:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a355fbb2/0x710df789068e7533 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853248.436438:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853248.436440:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853248.436442:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853248.438436:0:15016:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787853248.438460:0:15016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a355fbb2/0x710df789068e7533 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1787853248.438898:0:15016:0:(ofd_dev.c:1521:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00000100:00100000:1.0:1787853248.439004:0:15016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49092bfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:14354:x1874699552402176:12345-0@lo:5:osp-pre-1-0.0 Request processed in 195084us (195246us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853248.439015:0:15016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787853248.439309:0:14354:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49092bcf00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14354:1874699552402176:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1787853248.439329:0:14354:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:1.0:1787853248.439384:0:14354:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49056dad00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14354:1874699552402304:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1787853248.439436:0:14354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853248.439555:0:14354:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f492eb6c540 going to sleep for 11 seconds 00000100:00100000:2.0:1787853248.439691:0:15015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552402304 00000100:00100000:2.0:1787853248.439699:0:15015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552402304 00000100:00100000:2.0:1787853248.439750:0:15015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787853248.439760:0:15015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49056d9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:14354:x1874699552402304:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1787853248.439798:0:15015:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00010000:00010000:3.0:1787853248.446774:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787853248.457352:0:15015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49056d9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14354:x1874699552402304:12345-0@lo:5:osp-pre-1-0.0 Request processed in 17582us (17903us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1787853248.457368:0:15015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787853248.458268:0:14354:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49056dad00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14354:1874699552402304:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1787853248.458287:0:14354:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:0.0:1787853249.257781:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787853250.283140:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787853251.265363:0:16095:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg401-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787853251.305794:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787853252.330999:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787853252.842142:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4934116940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874699552402432:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787853252.842220:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853252.842429:0:15017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552402432 00000100:00100000:3.0:1787853252.842438:0:15017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552402432 00000100:00100000:3.0:1787853252.842507:0:15017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787853252.842517:0:15017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49092bed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874699552402432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787853252.842554:0:15017:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1787853252.843249:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787853252.843274:0:15017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49092bed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874699552402432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 757us (1052us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853252.843283:0:15017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787853252.854319:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4934116940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874699552402432:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787853253.357058:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787853253.368695:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49056d83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552402560:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787853253.368773:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853253.372338:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4934117840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874699552402816:0@lo:400:kworker.0 00000100:00100000:3.0:1787853253.372426:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853253.375435:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4934114f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1874699552403072:0@lo:400:kworker.0 00000100:00100000:1.0:1787853253.375510:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853253.375544:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787853253.375551:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4934115a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a76e730b-0783-4789-a5e2-a4230bb4bd66:3306:1874699552402688:0@lo:400:kworker.0 00000100:00100000:1.0:1787853253.375601:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853253.377020:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787853253.377036:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4934117480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1874699552402944:0@lo:400:kworker.0 00000100:00100000:3.0:1787853253.377271:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853253.382273:0:15018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552402560 00000100:00100000:1.0:1787853253.382290:0:15018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552402560 00000100:00100000:1.0:1787853253.382370:0:15018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787853253.382382:0:15018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49056d8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1874699552402560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787853253.382417:0:15018:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787853253.382508:0:15018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49056d8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1874699552402560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 129us (13734us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853253.382515:0:15018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787853253.382540:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552402816 00000100:00100000:1.0:1787853253.382545:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552402816 00000100:00100000:1.0:1787853253.382566:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552403072 00000100:00100000:1.0:1787853253.382585:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552403072 00000100:00100000:1.0:1787853253.382602:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552402944 00000100:00100000:1.0:1787853253.382605:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552402944 00000100:00100000:1.0:1787853253.382619:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787853253.382625:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4934116940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874699552402816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853253.382671:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4934116940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874699552402816:12345-0@lo:400:kworker.0 Request processed in 45us (10245us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853253.382690:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787853253.382703:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787853253.382708:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49056d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874699552403072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853253.382739:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49056d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874699552403072:12345-0@lo:400:kworker.0 Request processed in 31us (7229us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853253.382744:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787853253.382755:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787853253.382761:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49341170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874699552402944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853253.382788:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49341170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874699552402944:12345-0@lo:400:kworker.0 Request processed in 28us (5690us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853253.382794:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787853253.382832:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552402688 00000100:00100000:1.0:1787853253.382837:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552402688 00000100:00100000:1.0:1787853253.382862:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787853253.382869:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493dc1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a76e730b-0783-4789-a5e2-a4230bb4bd66+19:3306:x1874699552402688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853253.382903:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493dc1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a76e730b-0783-4789-a5e2-a4230bb4bd66+19:3306:x1874699552402688:12345-0@lo:400:kworker.0 Request processed in 34us (7301us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853253.382909:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:1.0:1787853253.382943:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787853253.382947:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787853253.382978:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4934115a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a76e730b-0783-4789-a5e2-a4230bb4bd66:3306:1874699552402688:0@lo:400:kworker.0 00010000:00080000:1.0:1787853253.382994:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f4934114f00 x1874699552403072/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787853269 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787853253.383008:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4934114f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1874699552403072:0@lo:400:kworker.0 00000100:00100000:1.0:1787853253.383042:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49056d83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552402560:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1787853253.383087:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f4934117480 x1874699552402944/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787853269 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787853253.383097:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4934117480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1874699552402944:0@lo:400:kworker.0 00010000:00080000:1.0:1787853253.385337:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f4934117840 x1874699552402816/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787853269 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787853253.385366:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4934117840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874699552402816:0@lo:400:kworker.0 00000001:00080000:1.0:1787853253.506415:0:7641:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000100:00100000:2.0:1787853254.057034:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853254.057371:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526187136 00000100:00100000:3.0:1787853254.057381:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526187136 00000100:00100000:3.0:1787853254.057433:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 77 00000100:00100000:3.0:1787853254.057441:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493dc1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2361:x1874699526187136:12345-192.168.204.1@tcp:250:mount.lustre.0 00010000:00080000:3.0:1787853254.057470:0:14324:0:(ldlm_lib.c:1454:target_handle_connect()) MGS: connection from f34adbd4-9a89-4f2c-8086-7f2012dc74db@192.168.204.1@tcp t0 exp 0000000000000000 cur 573 last 0 00000020:00000080:3.0:1787853254.057502:0:14324:0:(genops.c:1385:class_connect()) connect: client f34adbd4-9a89-4f2c-8086-7f2012dc74db, cookie 0x710df789068e753a 00000100:00080000:3.0:1787853254.057697:0:14324:0:(import.c:65:import_set_state_nolock()) ffff8f4908b1e000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787853254.057763:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493dc1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f34adbd4-9a89-4f2c-8086-7f2012dc74db+5:2361:x1874699526187136:12345-192.168.204.1@tcp:250:mount.lustre.0 Request processed in 322us (741us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853254.057771:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 77 00000100:00100000:0.0:1787853254.072364:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853254.072474:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526187264 00000100:00100000:1.0:1787853254.072484:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526187264 00000100:00100000:1.0:1787853254.072550:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 78 00000100:00100000:1.0:1787853254.072562:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493dc1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f34adbd4-9a89-4f2c-8086-7f2012dc74db+5:13766:x1874699526187264:12345-192.168.204.1@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787853254.072614:0:14322:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853254.072636:0:14322:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f4900030000/0x710df789068e7541 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xd0a9c5079389a01 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853254.072680:0:14322:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f4900030000/0x710df789068e7541 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389a01 expref: 6 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853254.072693:0:14322:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f4900030000/0x710df789068e7541 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389a01 expref: 6 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853254.072703:0:14322:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4900030000, rc 0) 00000100:00100000:1.0:1787853254.072784:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493dc1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f34adbd4-9a89-4f2c-8086-7f2012dc74db+6:13766:x1874699526187264:12345-192.168.204.1@tcp:101:mount.lustre.0 Request processed in 225us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853254.072816:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 78 00000100:00100000:0.0:1787853254.090663:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853254.090852:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526187392 00000100:00100000:1.0:1787853254.090862:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526187392 00000100:00100000:1.0:1787853254.090924:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 79 00000100:00100000:1.0:1787853254.090934:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493dc1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f34adbd4-9a89-4f2c-8086-7f2012dc74db+6:13766:x1874699526187392:12345-192.168.204.1@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787853254.091447:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493dc1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f34adbd4-9a89-4f2c-8086-7f2012dc74db+6:13766:x1874699526187392:12345-192.168.204.1@tcp:501:mount.lustre.0 Request processed in 513us (792us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787853254.091457:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 79 00000100:00100000:2.0:1787853254.105942:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853254.106045:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526187520 00000100:00100000:0.0:1787853254.106056:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526187520 00000100:00100000:0.0:1787853254.106121:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 80 00000100:00100000:0.0:1787853254.106131:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493dc1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f34adbd4-9a89-4f2c-8086-7f2012dc74db+6:13766:x1874699526187520:12345-192.168.204.1@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787853254.106147:0:14324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853254.106168:0:14324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f49415b9c00/0x710df789068e7548 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xd0a9c5079389a08 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853254.106215:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f49415b9c00/0x710df789068e7548 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389a08 expref: 7 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853254.106225:0:14324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f49415b9c00/0x710df789068e7548 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389a08 expref: 7 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853254.106235:0:14324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49415b9c00, rc 0) 00000100:00100000:0.0:1787853254.106293:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493dc1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f34adbd4-9a89-4f2c-8086-7f2012dc74db+7:13766:x1874699526187520:12345-192.168.204.1@tcp:101:mount.lustre.0 Request processed in 165us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853254.106299:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 80 00000100:00100000:0.0:1787853254.109204:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853254.109303:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526187648 00000100:00100000:3.0:1787853254.109312:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526187648 00000100:00100000:3.0:1787853254.109405:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 81 00000100:00100000:3.0:1787853254.109429:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493dc1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f34adbd4-9a89-4f2c-8086-7f2012dc74db+7:13766:x1874699526187648:12345-192.168.204.1@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787853254.109805:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493dc1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f34adbd4-9a89-4f2c-8086-7f2012dc74db+8:13766:x1874699526187648:12345-192.168.204.1@tcp:501:mount.lustre.0 Request processed in 376us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853254.109814:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 81 00000100:00100000:2.0:1787853254.115323:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853254.117868:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526187776 00000100:00100000:1.0:1787853254.117883:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526187776 00000100:00100000:1.0:1787853254.117958:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 82 00000100:00100000:1.0:1787853254.117968:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493dc1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f34adbd4-9a89-4f2c-8086-7f2012dc74db+8:13766:x1874699526187776:12345-192.168.204.1@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787853254.118424:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493dc1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f34adbd4-9a89-4f2c-8086-7f2012dc74db+8:13766:x1874699526187776:12345-192.168.204.1@tcp:503:mount.lustre.0 Request processed in 455us (3109us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853254.118432:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 82 00000100:00100000:2.0:1787853254.130934:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853254.131173:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526187904 00000100:00100000:3.0:1787853254.131184:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526187904 00000100:00100000:3.0:1787853254.131245:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 83 00000100:00100000:3.0:1787853254.131254:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493dc1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f34adbd4-9a89-4f2c-8086-7f2012dc74db+8:13784:x1874699526187904:12345-192.168.204.1@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787853254.135904:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493dc1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f34adbd4-9a89-4f2c-8086-7f2012dc74db+8:13784:x1874699526187904:12345-192.168.204.1@tcp:502:llog_process_th.0 Request processed in 4638us (4967us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853254.135919:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 83 00000100:00100000:2.0:1787853254.160247:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853254.160335:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526188032 00000100:00100000:0.0:1787853254.160353:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526188032 00000100:00100000:0.0:1787853254.160404:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 84 00000100:00100000:0.0:1787853254.160413:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493dc1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f34adbd4-9a89-4f2c-8086-7f2012dc74db+8:13784:x1874699526188032:12345-192.168.204.1@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787853254.161059:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493dc1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f34adbd4-9a89-4f2c-8086-7f2012dc74db+8:13784:x1874699526188032:12345-192.168.204.1@tcp:502:llog_process_th.0 Request processed in 643us (818us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853254.161069:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 84 00000100:00100000:0.0:1787853254.171049:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853254.171143:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526188160 00000100:00100000:2.0:1787853254.171154:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526188160 00000100:00100000:2.0:1787853254.171214:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 85 00000100:00100000:2.0:1787853254.171224:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493dc1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f34adbd4-9a89-4f2c-8086-7f2012dc74db+8:13766:x1874699526188160:12345-192.168.204.1@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787853254.171257:0:14322:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853254.171281:0:14322:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f4906503e00/0x710df789068e754f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd0a9c5079389a32 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853254.171310:0:14322:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f4906503e00/0x710df789068e754f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389a32 expref: 9 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853254.171322:0:14322:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f4906503e00/0x710df789068e754f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389a32 expref: 9 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853254.171331:0:14322:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4906503e00, rc 0) 00000100:00100000:2.0:1787853254.171407:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493dc1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f34adbd4-9a89-4f2c-8086-7f2012dc74db+9:13766:x1874699526188160:12345-192.168.204.1@tcp:101:mount.lustre.0 Request processed in 184us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853254.171414:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 85 00000100:00100000:2.0:1787853254.179864:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853254.182270:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526188288 00000100:00100000:1.0:1787853254.182286:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526188288 00000100:00100000:1.0:1787853254.182374:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 86 00000100:00100000:1.0:1787853254.182384:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493dc1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f34adbd4-9a89-4f2c-8086-7f2012dc74db+9:13766:x1874699526188288:12345-192.168.204.1@tcp:256:mount.lustre.0 20000000:01000000:1.0:1787853254.182411:0:14324:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1787853254.182436:0:14324:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1787853254.182449:0:14324:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1787853254.182457:0:14324:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1787853254.182459:0:14324:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1787853254.186115:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493dc1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f34adbd4-9a89-4f2c-8086-7f2012dc74db+9:13766:x1874699526188288:12345-192.168.204.1@tcp:256:mount.lustre.0 Request processed in 3720us (6249us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853254.186131:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 86 00000100:00100000:0.0:1787853254.202957:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853254.203120:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526188416 00000100:00100000:1.0:1787853254.203131:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526188416 00000100:00100000:1.0:1787853254.203188:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 87 00000100:00100000:1.0:1787853254.203198:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493dc1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f34adbd4-9a89-4f2c-8086-7f2012dc74db+9:13766:x1874699526188416:12345-192.168.204.1@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787853254.203216:0:14323:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853254.203234:0:14323:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f4900030200/0x710df789068e7556 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd0a9c5079389a39 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853254.203262:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f4900030200/0x710df789068e7556 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389a39 expref: 10 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853254.203274:0:14323:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f4900030200/0x710df789068e7556 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389a39 expref: 10 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853254.203283:0:14323:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4900030200, rc 0) 00000100:00100000:1.0:1787853254.203350:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493dc1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f34adbd4-9a89-4f2c-8086-7f2012dc74db+10:13766:x1874699526188416:12345-192.168.204.1@tcp:101:mount.lustre.0 Request processed in 145us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853254.203357:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 87 00000100:00100000:2.0:1787853254.206388:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853254.206490:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526188544 00000100:00100000:1.0:1787853254.206512:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526188544 00000100:00100000:1.0:1787853254.206618:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 88 00000100:00100000:1.0:1787853254.206629:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f491040e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f34adbd4-9a89-4f2c-8086-7f2012dc74db+10:13766:x1874699526188544:12345-192.168.204.1@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787853254.206939:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f491040e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f34adbd4-9a89-4f2c-8086-7f2012dc74db+10:13766:x1874699526188544:12345-192.168.204.1@tcp:501:mount.lustre.0 Request processed in 311us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853254.206966:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 88 00000100:00100000:0.0:1787853254.215525:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853254.215687:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526188672 00000100:00100000:2.0:1787853254.215699:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526188672 00000100:00100000:2.0:1787853254.215758:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 89 00000100:00100000:2.0:1787853254.215768:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f491040dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f34adbd4-9a89-4f2c-8086-7f2012dc74db+10:13766:x1874699526188672:12345-192.168.204.1@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787853254.216193:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f491040dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f34adbd4-9a89-4f2c-8086-7f2012dc74db+10:13766:x1874699526188672:12345-192.168.204.1@tcp:503:mount.lustre.0 Request processed in 424us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853254.216201:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 89 00000100:00100000:2.0:1787853254.220876:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853254.221165:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526188800 00000100:00100000:0.0:1787853254.221175:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526188800 00000100:00100000:0.0:1787853254.221235:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 90 00000100:00100000:0.0:1787853254.221246:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f491040e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f34adbd4-9a89-4f2c-8086-7f2012dc74db+10:13788:x1874699526188800:12345-192.168.204.1@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787853254.221842:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f491040e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f34adbd4-9a89-4f2c-8086-7f2012dc74db+10:13788:x1874699526188800:12345-192.168.204.1@tcp:502:llog_process_th.0 Request processed in 596us (974us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853254.221851:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 90 00000100:00100000:3.0:1787853254.228225:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853254.228388:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526188928 00000100:00100000:1.0:1787853254.228398:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526188928 00000100:00100000:1.0:1787853254.228464:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 91 00000100:00100000:1.0:1787853254.228473:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f491040c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f34adbd4-9a89-4f2c-8086-7f2012dc74db+10:13788:x1874699526188928:12345-192.168.204.1@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787853254.228746:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f491040c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f34adbd4-9a89-4f2c-8086-7f2012dc74db+10:13788:x1874699526188928:12345-192.168.204.1@tcp:502:llog_process_th.0 Request processed in 274us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853254.228754:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 91 00000100:00100000:1.0:1787853254.239174:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853254.239294:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526189056 00000100:00100000:2.0:1787853254.239303:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526189056 00000100:00100000:2.0:1787853254.239362:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 4 00000100:00100000:2.0:1787853254.239383:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49056d83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2361:x1874699526189056:12345-192.168.204.1@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787853254.239412:0:14331:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-MDT0000: connection from 4aa20631-d4eb-4b29-be9a-2c435d75f6dd@192.168.204.1@tcp t0 exp 0000000000000000 cur 573 last 0 00000020:00000080:2.0:1787853254.239465:0:14331:0:(genops.c:1385:class_connect()) connect: client 4aa20631-d4eb-4b29-be9a-2c435d75f6dd, cookie 0x710df789068e755d 00000004:00100000:2.0:1787853254.239495:0:14331:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1787853254.239501:0:14331:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:1.0:1787853254.306296:0:14331:0:(import.c:65:import_set_state_nolock()) ffff8f4934787800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787853254.306395:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49056d83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+6:2361:x1874699526189056:12345-192.168.204.1@tcp:38:mount.lustre.0 Request processed in 67010us (67231us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853254.306406:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 4 00000100:00100000:2.0:1787853254.315837:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853254.316763:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853254.317081:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526189184 00000100:00100000:0.0:1787853254.317092:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526189184 00000100:00100000:0.0:1787853254.317165:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526189312 00000100:00100000:0.0:1787853254.317168:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526189312 00000100:00100000:0.0:1787853254.317186:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 5 00000100:00100000:0.0:1787853254.317195:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f492eb88f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+7:0:x1874699526189184:12345-192.168.204.1@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787853254.317241:0:14329:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787853254.317326:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f492eb88f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+7:0:x1874699526189184:12345-192.168.204.1@tcp:41:mount.lustre.0 Request processed in 132us (1501us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853254.317333:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 5 00000100:00100000:0.0:1787853254.317364:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 6 00000100:00100000:0.0:1787853254.317371:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f492eb8ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+6:13766:x1874699526189312:12345-192.168.204.1@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787853254.317380:0:14329:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787853254.317400:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f492eb8ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+6:13766:x1874699526189312:12345-192.168.204.1@tcp:41:mount.lustre.0 Request processed in 30us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853254.317405:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 6 00000100:00080000:2.0:1787853254.317996:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787853254.319542:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853254.319719:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526189440 00000100:00100000:0.0:1787853254.319730:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526189440 00000100:00100000:0.0:1787853254.319781:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 7 00000100:00100000:0.0:1787853254.319791:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4934114000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+6:13766:x1874699526189440:12345-192.168.204.1@tcp:40:mount.lustre.0 00000100:00100000:0.0:1787853254.319870:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4934114000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+6:13766:x1874699526189440:12345-192.168.204.1@tcp:40:mount.lustre.0 Request processed in 81us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853254.319877:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 7 00000100:00100000:0.0:1787853254.324246:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853254.324289:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853254.324320:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853254.324751:0:15016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526189568 00000100:00100000:1.0:1787853254.324762:0:15016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526189568 00000100:00100000:1.0:1787853254.324803:0:15016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526189696 00000100:00100000:1.0:1787853254.324806:0:15016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526189696 00000100:00100000:1.0:1787853254.324823:0:15016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 8 00000100:00100000:1.0:1787853254.324832:0:15016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49092bcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2361:x1874699526189568:12345-192.168.204.1@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787853254.324864:0:15016:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0000: connection from 4aa20631-d4eb-4b29-be9a-2c435d75f6dd@192.168.204.1@tcp t0 exp 0000000000000000 cur 573 last 0 00000020:00000080:1.0:1787853254.324891:0:15016:0:(genops.c:1385:class_connect()) connect: client 4aa20631-d4eb-4b29-be9a-2c435d75f6dd, cookie 0x710df789068e7564 00002000:00100000:1.0:1787853254.324903:0:15016:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 4aa20631-d4eb-4b29-be9a-2c435d75f6dd/ffff8f4934784800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113954 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787853254.324913:0:15016:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:3.0:1787853254.325043:0:15498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 9 00000100:00100000:3.0:1787853254.325051:0:15498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49092bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2361:x1874699526189696:12345-192.168.204.1@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787853254.325134:0:15498:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0001: connection from 4aa20631-d4eb-4b29-be9a-2c435d75f6dd@192.168.204.1@tcp t0 exp 0000000000000000 cur 573 last 0 00000020:00000080:3.0:1787853254.325153:0:15498:0:(genops.c:1385:class_connect()) connect: client 4aa20631-d4eb-4b29-be9a-2c435d75f6dd, cookie 0x710df789068e756b 00002000:00100000:3.0:1787853254.325158:0:15498:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 4aa20631-d4eb-4b29-be9a-2c435d75f6dd/ffff8f4908b1e800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113954 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787853254.325165:0:15498:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787853254.325545:0:15498:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787853254.325611:0:15498:0:(import.c:65:import_set_state_nolock()) ffff8f494129c000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787853254.326199:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526189824 00000100:00100000:2.0:1787853254.326208:0:14332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526189824 00000100:00100000:2.0:1787853254.326253:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 0 00000100:00100000:2.0:1787853254.326263:0:14332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49092be1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+6:13766:x1874699526189824:12345-192.168.204.1@tcp:33:mount.lustre.0 00002000:00080000:1.0:1787853254.327762:0:15016:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787853254.327804:0:15016:0:(import.c:65:import_set_state_nolock()) ffff8f4934786800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787853254.327882:0:15016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49092bcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+6:2361:x1874699526189568:12345-192.168.204.1@tcp:8:mount.lustre.0 Request processed in 3049us (3646us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853254.327891:0:15016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 8 00000100:00100000:3.0:1787853254.327988:0:15498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49092bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+6:2361:x1874699526189696:12345-192.168.204.1@tcp:8:mount.lustre.0 Request processed in 2935us (3665us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853254.327996:0:15498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 9 00000004:00080000:0.0:1787853254.329034:0:14332:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 2676us 00000004:00200000:0.0:1787853254.351851:0:14332:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:0.0:1787853254.352294:0:14332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49092be1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+6:13766:x1874699526189824:12345-192.168.204.1@tcp:33:mount.lustre.0 Request processed in 26026us (27998us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853254.352311:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 0 00010000:00010000:3.0:1787853254.387161:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787853254.621354:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853254.621498:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526189952 00000100:00100000:3.0:1787853254.621509:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526189952 00000100:00100000:3.0:1787853254.621595:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 8 00000100:00100000:3.0:1787853254.621619:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49092bc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+6:13809:x1874699526189952:12345-192.168.204.1@tcp:101:mkdir.0 00010000:00010000:3.0:1787853254.621653:0:14331:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853254.621681:0:14331:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20800/0x710df789068e7572 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c5079389a63 expref: -99 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853254.621873:0:14331:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21600/0x710df789068e7579 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853254.621887:0:14331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21600/0x710df789068e7579 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853254.621902:0:14331:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21600/0x710df789068e7579 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787853254.622343:0:14331:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787853254.622349:0:14331:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1787853254.622447:0:14331:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21600/0x710df789068e7579 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853254.622478:0:14331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20800/0x710df789068e7572 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389a63 expref: 8 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853254.622498:0:14331:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21600/0x710df789068e7579 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389a63 expref: 7 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853254.622507:0:14331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f4910f92600) 00010000:00010000:3.0:1787853254.622510:0:14331:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787853254.622513:0:14331:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4921e21600, rc 0) 00000100:00100000:3.0:1787853254.622679:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49092bc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+7:13809:x1874699526189952:12345-192.168.204.1@tcp:101:mkdir.0 Request processed in 1061us (1347us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853254.622706:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 8 00000040:00080000:3.0:1787853254.890538:0:14361:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787853255.401768:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787853256.425875:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787853256.778547:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853256.778784:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526190080 00000100:00100000:1.0:1787853256.778796:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526190080 00000100:00100000:1.0:1787853256.778880:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 9 00000100:00100000:1.0:1787853256.778901:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49341161c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+7:13861:x1874699526190080:12345-192.168.204.1@tcp:41:lfs.0 00000004:00000024:1.0:1787853256.778949:0:14330:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1787853256.779060:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49341161c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+7:13861:x1874699526190080:12345-192.168.204.1@tcp:41:lfs.0 Request processed in 170us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853256.779068:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 9 00000100:00080000:2.0:1787853256.779137:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787853256.793641:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853256.793787:0:15018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526190208 00000100:00100000:1.0:1787853256.793798:0:15018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526190208 00000100:00100000:1.0:1787853256.793876:0:15018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 6 00000100:00100000:1.0:1787853256.793885:0:15018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49092bf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+6:13861:x1874699526190208:12345-192.168.204.1@tcp:13:lfs.0 00002000:00000024:1.0:1787853256.793939:0:15018:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787853256.794028:0:15018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49092bf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+6:13861:x1874699526190208:12345-192.168.204.1@tcp:13:lfs.0 Request processed in 144us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853256.794035:0:15018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 6 00000100:00080000:2.0:1787853256.794104:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787853256.797909:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853256.798657:0:15018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526190336 00000100:00100000:1.0:1787853256.798670:0:15018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526190336 00000100:00100000:1.0:1787853256.798790:0:15018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 7 00000100:00100000:1.0:1787853256.798802:0:15018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49341143c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+6:13861:x1874699526190336:12345-192.168.204.1@tcp:13:lfs.0 00002000:00000024:1.0:1787853256.798844:0:15018:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787853256.798952:0:15018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49341143c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+6:13861:x1874699526190336:12345-192.168.204.1@tcp:13:lfs.0 Request processed in 151us (1061us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853256.798979:0:15018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 7 00000100:00080000:2.0:1787853256.805431:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787853257.067503:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853257.067613:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526190464 00000100:00100000:2.0:1787853257.067622:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526190464 00000100:00100000:2.0:1787853257.067679:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 92 00000100:00100000:2.0:1787853257.067689:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f491040f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f34adbd4-9a89-4f2c-8086-7f2012dc74db+10:13891:x1874699526190464:12345-192.168.204.1@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787853257.067709:0:14322:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853257.067727:0:14322:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f4906502400/0x710df789068e7580 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xd0a9c5079389a6a expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853257.067755:0:14322:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f4906502400/0x710df789068e7580 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389a6a expref: 11 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853257.067766:0:14322:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f4906502400/0x710df789068e7580 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389a6a expref: 11 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853257.067789:0:14322:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4906502400, rc 0) 00000100:00100000:2.0:1787853257.068149:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f491040f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f34adbd4-9a89-4f2c-8086-7f2012dc74db+11:13891:x1874699526190464:12345-192.168.204.1@tcp:101:mount.lustre.0 Request processed in 460us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853257.068158:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 92 00000100:00100000:0.0:1787853257.082748:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853257.088311:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526190592 00000100:00100000:1.0:1787853257.088327:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526190592 00000100:00100000:1.0:1787853257.088473:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 93 00000100:00100000:1.0:1787853257.088484:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f491040c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f34adbd4-9a89-4f2c-8086-7f2012dc74db+11:13891:x1874699526190592:12345-192.168.204.1@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787853257.088825:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f491040c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f34adbd4-9a89-4f2c-8086-7f2012dc74db+11:13891:x1874699526190592:12345-192.168.204.1@tcp:501:mount.lustre.0 Request processed in 341us (6086us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853257.088832:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 93 00000100:00100000:3.0:1787853257.094101:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853257.094786:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526190720 00000100:00100000:0.0:1787853257.094799:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526190720 00000100:00100000:0.0:1787853257.094907:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 94 00000100:00100000:0.0:1787853257.094918:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f491040d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f34adbd4-9a89-4f2c-8086-7f2012dc74db+11:13891:x1874699526190720:12345-192.168.204.1@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787853257.095188:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f491040d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f34adbd4-9a89-4f2c-8086-7f2012dc74db+11:13891:x1874699526190720:12345-192.168.204.1@tcp:503:mount.lustre.0 Request processed in 272us (1096us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853257.095195:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 94 00000100:00100000:0.0:1787853257.107805:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853257.108658:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526190848 00000100:00100000:1.0:1787853257.108670:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526190848 00000100:00100000:1.0:1787853257.108782:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 95 00000100:00100000:1.0:1787853257.108793:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f491040f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f34adbd4-9a89-4f2c-8086-7f2012dc74db+11:13899:x1874699526190848:12345-192.168.204.1@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787853257.109142:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f491040f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f34adbd4-9a89-4f2c-8086-7f2012dc74db+11:13899:x1874699526190848:12345-192.168.204.1@tcp:502:llog_process_th.0 Request processed in 350us (1348us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853257.109152:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 95 00000100:00100000:3.0:1787853257.142084:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853257.142551:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526190976 00000100:00100000:0.0:1787853257.142563:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526190976 00000100:00100000:0.0:1787853257.143398:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 96 00000100:00100000:0.0:1787853257.143411:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f491040d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f34adbd4-9a89-4f2c-8086-7f2012dc74db+11:13899:x1874699526190976:12345-192.168.204.1@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787853257.143743:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f491040d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f34adbd4-9a89-4f2c-8086-7f2012dc74db+11:13899:x1874699526190976:12345-192.168.204.1@tcp:502:llog_process_th.0 Request processed in 333us (1668us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853257.143752:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 96 00000100:00100000:3.0:1787853257.152644:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853257.152739:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526191104 00000100:00100000:1.0:1787853257.152749:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526191104 00000100:00100000:1.0:1787853257.152808:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 97 00000100:00100000:1.0:1787853257.152818:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f491040c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f34adbd4-9a89-4f2c-8086-7f2012dc74db+11:13891:x1874699526191104:12345-192.168.204.1@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787853257.152836:0:14324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853257.152854:0:14324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f4900030400/0x710df789068e7587 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd0a9c5079389a94 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853257.152884:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f4900030400/0x710df789068e7587 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389a94 expref: 12 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853257.152916:0:14324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f4900030400/0x710df789068e7587 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389a94 expref: 12 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853257.152926:0:14324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4900030400, rc 0) 00000100:00100000:1.0:1787853257.152988:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f491040c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f34adbd4-9a89-4f2c-8086-7f2012dc74db+12:13891:x1874699526191104:12345-192.168.204.1@tcp:101:mount.lustre.0 Request processed in 172us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853257.152996:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 97 00000100:00100000:3.0:1787853257.157847:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853257.158072:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526191232 00000100:00100000:2.0:1787853257.158082:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526191232 00000100:00100000:2.0:1787853257.158137:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 98 00000100:00100000:2.0:1787853257.158146:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f491040cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f34adbd4-9a89-4f2c-8086-7f2012dc74db+12:13891:x1874699526191232:12345-192.168.204.1@tcp:256:mount.lustre.0 20000000:01000000:2.0:1787853257.158170:0:14322:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1787853257.158194:0:14322:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787853257.158198:0:14322:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1787853257.158201:0:14322:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1787853257.158203:0:14322:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1787853257.165308:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f491040cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f34adbd4-9a89-4f2c-8086-7f2012dc74db+12:13891:x1874699526191232:12345-192.168.204.1@tcp:256:mount.lustre.0 Request processed in 7148us (7454us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853257.165325:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 98 00000100:00100000:3.0:1787853257.173228:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853257.173885:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526191360 00000100:00100000:0.0:1787853257.173898:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526191360 00000100:00100000:0.0:1787853257.173979:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 99 00000100:00100000:0.0:1787853257.173989:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49054a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f34adbd4-9a89-4f2c-8086-7f2012dc74db+12:13891:x1874699526191360:12345-192.168.204.1@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787853257.174007:0:14323:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853257.174026:0:14323:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f49415b8800/0x710df789068e758e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd0a9c5079389a9b expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853257.174056:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f49415b8800/0x710df789068e758e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389a9b expref: 13 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853257.174067:0:14323:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f49415b8800/0x710df789068e758e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389a9b expref: 13 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853257.174077:0:14323:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49415b8800, rc 0) 00000100:00100000:0.0:1787853257.174270:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49054a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f34adbd4-9a89-4f2c-8086-7f2012dc74db+13:13891:x1874699526191360:12345-192.168.204.1@tcp:101:mount.lustre.0 Request processed in 281us (1053us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853257.174277:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 99 00000100:00100000:3.0:1787853257.184667:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853257.184881:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526191488 00000100:00100000:2.0:1787853257.184900:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526191488 00000100:00100000:2.0:1787853257.184959:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 100 00000100:00100000:2.0:1787853257.184969:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49054a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f34adbd4-9a89-4f2c-8086-7f2012dc74db+13:13891:x1874699526191488:12345-192.168.204.1@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787853257.185553:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49054a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f34adbd4-9a89-4f2c-8086-7f2012dc74db+13:13891:x1874699526191488:12345-192.168.204.1@tcp:501:mount.lustre.0 Request processed in 581us (891us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853257.185561:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 100 00000100:00100000:3.0:1787853257.191634:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853257.191831:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526191616 00000100:00100000:0.0:1787853257.191842:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526191616 00000100:00100000:0.0:1787853257.191915:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 101 00000100:00100000:0.0:1787853257.191926:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49054a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f34adbd4-9a89-4f2c-8086-7f2012dc74db+13:13891:x1874699526191616:12345-192.168.204.1@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787853257.192401:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49054a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f34adbd4-9a89-4f2c-8086-7f2012dc74db+13:13891:x1874699526191616:12345-192.168.204.1@tcp:503:mount.lustre.0 Request processed in 475us (775us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853257.192411:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 101 00000100:00100000:0.0:1787853257.206459:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853257.207133:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526191744 00000100:00100000:2.0:1787853257.207145:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526191744 00000100:00100000:2.0:1787853257.207314:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 102 00000100:00100000:2.0:1787853257.207325:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49054a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f34adbd4-9a89-4f2c-8086-7f2012dc74db+13:13903:x1874699526191744:12345-192.168.204.1@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787853257.207784:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49054a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f34adbd4-9a89-4f2c-8086-7f2012dc74db+13:13903:x1874699526191744:12345-192.168.204.1@tcp:502:llog_process_th.0 Request processed in 459us (1333us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853257.207792:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 102 00000100:00100000:3.0:1787853257.227133:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853257.228060:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526191872 00000100:00100000:1.0:1787853257.228073:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526191872 00000100:00100000:1.0:1787853257.228136:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 103 00000100:00100000:1.0:1787853257.228146:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49054a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f34adbd4-9a89-4f2c-8086-7f2012dc74db+13:13903:x1874699526191872:12345-192.168.204.1@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787853257.228722:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49054a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f34adbd4-9a89-4f2c-8086-7f2012dc74db+13:13903:x1874699526191872:12345-192.168.204.1@tcp:502:llog_process_th.0 Request processed in 574us (1600us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853257.228733:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 103 00000100:00100000:3.0:1787853257.237994:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853257.241070:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526192000 00000100:00100000:1.0:1787853257.241089:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526192000 00000100:00100000:1.0:1787853257.241353:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 10 00000100:00100000:1.0:1787853257.241371:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4934116d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2361:x1874699526192000:12345-192.168.204.1@tcp:38:mount.lustre.0 00010000:00080000:1.0:1787853257.241420:0:14331:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-MDT0000: connection from 23cfdd4f-7ffb-4b42-8d8e-04a589e53647@192.168.204.1@tcp t0 exp 0000000000000000 cur 576 last 0 00000020:00000080:1.0:1787853257.241468:0:14331:0:(genops.c:1385:class_connect()) connect: client 23cfdd4f-7ffb-4b42-8d8e-04a589e53647, cookie 0x710df789068e7595 00000004:00100000:1.0:1787853257.241517:0:14331:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1787853257.241701:0:14331:0:(import.c:65:import_set_state_nolock()) ffff8f4906524800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787853257.241790:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4934116d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23cfdd4f-7ffb-4b42-8d8e-04a589e53647+6:2361:x1874699526192000:12345-192.168.204.1@tcp:38:mount.lustre.0 Request processed in 427us (3807us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853257.241820:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 10 00000100:00100000:0.0:1787853257.254370:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853257.254467:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853257.254615:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526192128 00000100:00100000:1.0:1787853257.254626:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526192128 00000100:00100000:1.0:1787853257.254704:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526192256 00000100:00100000:1.0:1787853257.254708:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526192256 00000100:00100000:1.0:1787853257.254726:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 11 00000100:00100000:1.0:1787853257.254734:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49092bf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23cfdd4f-7ffb-4b42-8d8e-04a589e53647+7:0:x1874699526192128:12345-192.168.204.1@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787853257.254769:0:14329:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1787853257.254843:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49092bf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23cfdd4f-7ffb-4b42-8d8e-04a589e53647+7:0:x1874699526192128:12345-192.168.204.1@tcp:41:mount.lustre.0 Request processed in 108us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853257.254851:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 11 00000100:00100000:1.0:1787853257.254871:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 12 00000100:00100000:1.0:1787853257.254878:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49092bde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23cfdd4f-7ffb-4b42-8d8e-04a589e53647+6:13891:x1874699526192256:12345-192.168.204.1@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787853257.254896:0:14329:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1787853257.254919:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49092bde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23cfdd4f-7ffb-4b42-8d8e-04a589e53647+6:13891:x1874699526192256:12345-192.168.204.1@tcp:41:mount.lustre.0 Request processed in 40us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853257.254925:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 12 00000100:00080000:3.0:1787853257.255406:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787853257.258977:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853257.259182:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526192384 00000100:00100000:1.0:1787853257.259192:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526192384 00000100:00100000:1.0:1787853257.259321:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 13 00000100:00100000:1.0:1787853257.259332:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4934115e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23cfdd4f-7ffb-4b42-8d8e-04a589e53647+6:13891:x1874699526192384:12345-192.168.204.1@tcp:40:mount.lustre.0 00000100:00100000:1.0:1787853257.259435:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4934115e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23cfdd4f-7ffb-4b42-8d8e-04a589e53647+6:13891:x1874699526192384:12345-192.168.204.1@tcp:40:mount.lustre.0 Request processed in 105us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853257.259442:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 13 00000100:00100000:3.0:1787853257.269548:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853257.269610:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853257.269661:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853257.269708:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526192768 00000100:00100000:3.0:1787853257.269718:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526192768 00000100:00100000:3.0:1787853257.269766:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 1 00000100:00100000:3.0:1787853257.269775:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4934117840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:23cfdd4f-7ffb-4b42-8d8e-04a589e53647+6:13891:x1874699526192768:12345-192.168.204.1@tcp:33:mount.lustre.0 00000004:00200000:3.0:1787853257.270052:0:14333:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:3.0:1787853257.270207:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4934117840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:23cfdd4f-7ffb-4b42-8d8e-04a589e53647+6:13891:x1874699526192768:12345-192.168.204.1@tcp:33:mount.lustre.0 Request processed in 432us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853257.270225:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 1 00000100:00100000:0.0:1787853257.272646:0:15015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526192512 00000100:00100000:0.0:1787853257.272677:0:15015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526192512 00000100:00100000:0.0:1787853257.272718:0:15015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526192640 00000100:00100000:0.0:1787853257.272722:0:15015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526192640 00000100:00100000:0.0:1787853257.272751:0:15015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 10 00000100:00100000:0.0:1787853257.272760:0:15015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4934114780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2361:x1874699526192512:12345-192.168.204.1@tcp:8:mount.lustre.0 00010000:00080000:0.0:1787853257.272801:0:15015:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0000: connection from 23cfdd4f-7ffb-4b42-8d8e-04a589e53647@192.168.204.1@tcp t0 exp 0000000000000000 cur 576 last 0 00000020:00000080:0.0:1787853257.272837:0:15015:0:(genops.c:1385:class_connect()) connect: client 23cfdd4f-7ffb-4b42-8d8e-04a589e53647, cookie 0x710df789068e759c 00002000:00100000:0.0:1787853257.272851:0:15015:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 23cfdd4f-7ffb-4b42-8d8e-04a589e53647/ffff8f493d124800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113954 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787853257.272865:0:15015:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:3.0:1787853257.273375:0:15498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 11 00000100:00100000:3.0:1787853257.273383:0:15498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4934117c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2361:x1874699526192640:12345-192.168.204.1@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787853257.273403:0:15498:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0001: connection from 23cfdd4f-7ffb-4b42-8d8e-04a589e53647@192.168.204.1@tcp t0 exp 0000000000000000 cur 576 last 0 00000020:00000080:3.0:1787853257.273425:0:15498:0:(genops.c:1385:class_connect()) connect: client 23cfdd4f-7ffb-4b42-8d8e-04a589e53647, cookie 0x710df789068e75a3 00002000:00100000:3.0:1787853257.273431:0:15498:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 23cfdd4f-7ffb-4b42-8d8e-04a589e53647/ffff8f49079ec800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113954 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787853257.273439:0:15498:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787853257.273653:0:15015:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787853257.273685:0:15015:0:(import.c:65:import_set_state_nolock()) ffff8f493d125800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787853257.273755:0:15015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4934114780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:23cfdd4f-7ffb-4b42-8d8e-04a589e53647+6:2361:x1874699526192512:12345-192.168.204.1@tcp:8:mount.lustre.0 Request processed in 994us (4217us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853257.273764:0:15015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 10 00002000:00080000:3.0:1787853257.275007:0:15498:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787853257.275049:0:15498:0:(import.c:65:import_set_state_nolock()) ffff8f4903015800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787853257.275107:0:15498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4934117c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:23cfdd4f-7ffb-4b42-8d8e-04a589e53647+6:2361:x1874699526192640:12345-192.168.204.1@tcp:8:mount.lustre.0 Request processed in 1722us (5496us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853257.275117:0:15498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 11 00010000:00010000:3.0:1787853257.453199:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787853257.649759:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853257.649867:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526192896 00000100:00100000:2.0:1787853257.649878:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526192896 00000100:00100000:2.0:1787853257.649954:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 14 00000100:00100000:2.0:1787853257.649964:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4934117480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23cfdd4f-7ffb-4b42-8d8e-04a589e53647+6:13924:x1874699526192896:12345-192.168.204.1@tcp:101:mkdir.0 00010000:00010000:2.0:1787853257.649983:0:14330:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853257.650006:0:14330:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906502e00/0x710df789068e75aa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c5079389ac5 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853257.650083:0:14330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503000/0x710df789068e75b1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853257.650098:0:14330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503000/0x710df789068e75b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853257.650112:0:14330:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503000/0x710df789068e75b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787853257.650360:0:14330:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787853257.650365:0:14330:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1787853257.650468:0:14330:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503000/0x710df789068e75b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853257.650502:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906502e00/0x710df789068e75aa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389ac5 expref: 8 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853257.650533:0:14330:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503000/0x710df789068e75b1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389ac5 expref: 7 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853257.650542:0:14330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f4910f92600) 00010000:00010000:2.0:1787853257.650545:0:14330:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787853257.650550:0:14330:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4906503000, rc 0) 00000100:00100000:2.0:1787853257.650798:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4934117480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23cfdd4f-7ffb-4b42-8d8e-04a589e53647+7:13924:x1874699526192896:12345-192.168.204.1@tcp:101:mkdir.0 Request processed in 835us (1048us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853257.650805:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 14 00000100:00100000:3.0:1787853257.962948:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4934114f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874699552403200:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787853257.963030:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853257.963131:0:15018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552403200 00000100:00100000:3.0:1787853257.963139:0:15018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552403200 00000100:00100000:3.0:1787853257.963311:0:15018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787853257.963322:0:15018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4934115a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874699552403200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787853257.963346:0:15018:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787853257.963392:0:15018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4934115a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874699552403200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853257.963399:0:15018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1787853257.963447:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787853257.963485:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4934114f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874699552403200:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787853258.473795:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787853258.474104:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49092bd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a76e730b-0783-4789-a5e2-a4230bb4bd66:3309:1874699552403456:0@lo:400:kworker.0 00000100:00100000:0.0:1787853258.474108:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49092bcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552403584:0@lo:400:kworker.0 00000100:00100000:1.0:1787853258.474144:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49056d8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874699552403328:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787853258.474467:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49092bda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874699552403712:0@lo:400:kworker.0 00000100:00100000:2.0:1787853258.479267:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853258.479344:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4941741e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1874699552403968:0@lo:400:kworker.0 00000100:00100000:2.0:1787853258.479387:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853258.479420:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787853258.479427:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4941741680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874699552403840:0@lo:400:kworker.0 00000100:00100000:2.0:1787853258.479450:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853258.479489:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552403456 00000100:00100000:2.0:1787853258.479497:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552403456 00000100:00100000:2.0:1787853258.479541:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787853258.479551:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49054a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a76e730b-0783-4789-a5e2-a4230bb4bd66+19:3309:x1874699552403456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853258.479628:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49054a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a76e730b-0783-4789-a5e2-a4230bb4bd66+19:3309:x1874699552403456:12345-0@lo:400:kworker.0 Request processed in 78us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853258.479636:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787853258.481470:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49092bd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a76e730b-0783-4789-a5e2-a4230bb4bd66:3309:1874699552403456:0@lo:400:kworker.0 00000100:00100000:0.0:1787853258.483539:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853258.483613:0:15015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552403584 00000100:00100000:0.0:1787853258.483623:0:15015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552403584 00000100:00100000:0.0:1787853258.483681:0:15015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787853258.483692:0:15015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4941743c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874699552403584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853258.483754:0:15015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4941743c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874699552403584:12345-0@lo:400:kworker.0 Request processed in 64us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853258.483762:0:15015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787853258.483821:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49092bcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552403584:0@lo:400:kworker.0 00000100:00100000:0.0:1787853258.483834:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4941743480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1874699552404096:0@lo:400:kworker.0 00000100:00100000:0.0:1787853258.483896:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853258.484441:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552403968 00000100:00100000:2.0:1787853258.484448:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552403968 00000100:00100000:2.0:1787853258.484488:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552403840 00000100:00100000:2.0:1787853258.484492:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552403840 00000100:00100000:2.0:1787853258.484504:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552404096 00000100:00100000:2.0:1787853258.484506:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552404096 00000100:00100000:2.0:1787853258.484522:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787853258.484528:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f492eb88780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874699552403968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853258.484601:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f492eb88780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874699552403968:12345-0@lo:400:kworker.0 Request processed in 72us (5212us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853258.485694:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787853258.485728:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787853258.485741:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f492eb8a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874699552403840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853258.485807:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f492eb8a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874699552403840:12345-0@lo:400:kworker.0 Request processed in 72us (6354us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853258.485813:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787853258.485825:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787853258.485832:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49417412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874699552404096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853258.486162:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49417412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874699552404096:12345-0@lo:400:kworker.0 Request processed in 329us (2264us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853258.486169:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787853258.486233:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4941741680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874699552403840:0@lo:400:kworker.0 00000100:00100000:2.0:1787853258.486249:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4941741e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1874699552403968:0@lo:400:kworker.0 00000100:00100000:2.0:1787853258.486305:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4941743480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1874699552404096:0@lo:400:kworker.0 00000100:00080000:2.0:1787853258.486419:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787853258.488895:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853258.488973:0:15018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552403328 00000100:00100000:1.0:1787853258.488984:0:15018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552403328 00000100:00100000:1.0:1787853258.489066:0:15018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787853258.489077:0:15018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49056db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874699552403328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787853258.489118:0:15018:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787853258.489160:0:15018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49056db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874699552403328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853258.489167:0:15018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1787853258.489193:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787853258.489224:0:3308:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1787853258.489251:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49056d8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874699552403328:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787853258.491736:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853258.491958:0:15016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552403712 00000100:00100000:1.0:1787853258.491968:0:15016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552403712 00000100:00100000:1.0:1787853258.493396:0:15016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787853258.493427:0:15016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4934114f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874699552403712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853258.493515:0:15016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4934114f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874699552403712:12345-0@lo:400:kworker.0 Request processed in 98us (1786us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853258.493523:0:15016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787853258.501135:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49092bda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874699552403712:0@lo:400:kworker.0 00000001:00100000:1.0:1787853258.593708:0:7641:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 23cfdd4f-7ffb-4b42-8d8e-04a589e53647 00000001:00100000:1.0:1787853258.593724:0:7641:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4aa20631-d4eb-4b29-be9a-2c435d75f6dd 00000001:00100000:0.0:1787853259.101503:0:6712:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 23cfdd4f-7ffb-4b42-8d8e-04a589e53647 00000001:00100000:0.0:1787853259.101520:0:6712:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4aa20631-d4eb-4b29-be9a-2c435d75f6dd 00010000:00010000:2.0:1787853259.502169:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787853259.608362:0:5858:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 23cfdd4f-7ffb-4b42-8d8e-04a589e53647 00000001:00100000:1.0:1787853259.608378:0:5858:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 4aa20631-d4eb-4b29-be9a-2c435d75f6dd 00010000:00010000:1.0:1787853260.525360:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787853261.413042:0:16299:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1787853261.566288:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853262.571520:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787853262.673292:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853262.673337:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853262.673376:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853262.673407:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853262.673426:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853262.673449:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853262.673475:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853262.673505:0:15013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526193280 00000100:00100000:0.0:1787853262.673514:0:15013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526193280 00000100:00100000:0.0:1787853262.673610:0:15013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526193408 00000100:00100000:0.0:1787853262.673614:0:15013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526193408 00000100:00100000:0.0:1787853262.673647:0:15013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526193664 00000100:00100000:0.0:1787853262.673651:0:15013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526193664 00000100:00100000:0.0:1787853262.673665:0:15013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526193792 00000100:00100000:0.0:1787853262.673667:0:15013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526193792 00000100:00100000:0.0:1787853262.673681:0:15013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 3 00000100:00100000:0.0:1787853262.673690:0:15013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49417430c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+5:2363:x1874699526193280:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:0.0:1787853262.673762:0:15013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49417430c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+5:2363:x1874699526193280:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 73us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853262.673770:0:15013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 3 00000100:00100000:0.0:1787853262.673789:0:15013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 4 00000100:00100000:0.0:1787853262.673795:0:15013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4941740000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+5:2362:x1874699526193408:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:0.0:1787853262.673834:0:15013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4941740000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+5:2362:x1874699526193408:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 40us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853262.673839:0:15013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 4 00000100:00100000:0.0:1787853262.673850:0:15013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 5 00000100:00100000:0.0:1787853262.673855:0:15013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4941741a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:23cfdd4f-7ffb-4b42-8d8e-04a589e53647+5:2362:x1874699526193664:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:0.0:1787853262.673870:0:15013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4941741a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:23cfdd4f-7ffb-4b42-8d8e-04a589e53647+5:2362:x1874699526193664:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 16us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853262.673875:0:15013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 5 00000100:00100000:0.0:1787853262.673883:0:15013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 6 00000100:00100000:0.0:1787853262.673888:0:15013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4941742580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:23cfdd4f-7ffb-4b42-8d8e-04a589e53647+5:2363:x1874699526193792:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:0.0:1787853262.673905:0:15013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4941742580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:23cfdd4f-7ffb-4b42-8d8e-04a589e53647+5:2363:x1874699526193792:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 17us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853262.673910:0:15013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 6 00000100:00100000:2.0:1787853262.674426:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526193536 00000100:00100000:2.0:1787853262.674433:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526193536 00000100:00100000:2.0:1787853262.674481:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526193152 00000100:00100000:2.0:1787853262.674485:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526193152 00000100:00100000:2.0:1787853262.674505:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 18 00000100:00100000:2.0:1787853262.674520:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4941743840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23cfdd4f-7ffb-4b42-8d8e-04a589e53647+6:2363:x1874699526193536:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:2.0:1787853262.674615:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4941743840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23cfdd4f-7ffb-4b42-8d8e-04a589e53647+6:2363:x1874699526193536:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 95us (1237us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853262.674621:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 18 00000100:00100000:2.0:1787853262.674640:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 19 00000100:00100000:2.0:1787853262.674655:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4941742d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+6:2362:x1874699526193152:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:2.0:1787853262.674681:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4941742d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+6:2362:x1874699526193152:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 34us (1273us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853262.674688:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 19 00000100:00100000:1.0:1787853262.674839:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526193024 00000100:00100000:1.0:1787853262.674844:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526193024 00000100:00100000:1.0:1787853262.674890:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 105 00000100:00100000:1.0:1787853262.674897:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49054a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f34adbd4-9a89-4f2c-8086-7f2012dc74db+13:2363:x1874699526193024:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:1.0:1787853262.674934:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49054a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f34adbd4-9a89-4f2c-8086-7f2012dc74db+13:2363:x1874699526193024:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 38us (1652us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853262.674941:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 105 00000100:00080000:1.0:1787853262.674973:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787853262.674977:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787853262.674980:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787853263.082149:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787853263.082187:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4941af1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552404224:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787853263.082274:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853263.083065:0:15018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552404224 00000100:00100000:1.0:1787853263.083076:0:15018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552404224 00000100:00100000:1.0:1787853263.083156:0:15018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787853263.083176:0:15018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4941740b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874699552404224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787853263.083215:0:15018:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1787853263.083407:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787853263.083603:0:15018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4941740b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874699552404224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 438us (1328us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853263.083611:0:15018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787853263.083750:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4941af1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552404224:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787853263.595544:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787853263.597808:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4920570780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874699552404480:0@lo:400:kworker.0 00000100:00100000:2.0:1787853263.597881:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853263.597936:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49079f2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1874699552404992:0@lo:400:kworker.0 00000100:00100000:2.0:1787853263.597962:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853263.597989:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787853263.597995:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f492eb8a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a76e730b-0783-4789-a5e2-a4230bb4bd66:3309:1874699552404352:0@lo:400:kworker.0 00000100:00100000:2.0:1787853263.598021:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853263.598053:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49079f21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1874699552404864:0@lo:400:kworker.0 00000100:00100000:2.0:1787853263.598075:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853263.598101:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49079f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552404608:0@lo:400:kworker.0 00000100:00100000:2.0:1787853263.598123:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853263.598142:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787853263.598147:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49079f03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874699552404736:0@lo:400:kworker.0 00000100:00100000:2.0:1787853263.598180:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853263.598214:0:15013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552404480 00000100:00100000:2.0:1787853263.598221:0:15013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552404480 00000100:00100000:2.0:1787853263.598263:0:15013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552404608 00000100:00100000:2.0:1787853263.598266:0:15013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552404608 00000100:00100000:2.0:1787853263.598296:0:15013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787853263.598316:0:15013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49079f0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1874699552404480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853263.598368:0:15013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49079f0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1874699552404480:12345-0@lo:400:kworker.0 Request processed in 63us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853263.598375:0:15013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787853263.598392:0:15013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787853263.598398:0:15013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49079f2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874699552404608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853263.598429:0:15013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49079f2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874699552404608:12345-0@lo:400:kworker.0 Request processed in 31us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853263.598435:0:15013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787853263.598452:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552404992 00000100:00100000:2.0:1787853263.598455:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552404992 00000100:00100000:2.0:1787853263.598474:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552404864 00000100:00100000:2.0:1787853263.598477:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552404864 00000100:00100000:2.0:1787853263.598489:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552404736 00000100:00100000:2.0:1787853263.598492:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552404736 00000100:00100000:2.0:1787853263.598504:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787853263.598518:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49079f3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874699552404992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853263.598552:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49079f3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874699552404992:12345-0@lo:400:kworker.0 Request processed in 35us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853263.598558:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787853263.598589:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787853263.598595:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49079f2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874699552404864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853263.598623:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49079f2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874699552404864:12345-0@lo:400:kworker.0 Request processed in 28us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853263.598629:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787853263.598640:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787853263.598646:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49079f0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874699552404736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853263.598674:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49079f0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874699552404736:12345-0@lo:400:kworker.0 Request processed in 28us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853263.598680:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787853263.598699:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552404352 00000100:00100000:2.0:1787853263.598702:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552404352 00000100:00100000:2.0:1787853263.598726:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787853263.598732:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49054a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a76e730b-0783-4789-a5e2-a4230bb4bd66+19:3309:x1874699552404352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853263.598763:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49054a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a76e730b-0783-4789-a5e2-a4230bb4bd66+19:3309:x1874699552404352:12345-0@lo:400:kworker.0 Request processed in 31us (740us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853263.598769:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00080000:2.0:1787853263.598808:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787853263.598813:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787853263.599112:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49079f03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874699552404736:0@lo:400:kworker.0 00000100:00100000:2.0:1787853263.599125:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49079f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552404608:0@lo:400:kworker.0 00000100:00100000:2.0:1787853263.599189:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f492eb8a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a76e730b-0783-4789-a5e2-a4230bb4bd66:3309:1874699552404352:0@lo:400:kworker.0 00000100:00100000:2.0:1787853263.599201:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49079f21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1874699552404864:0@lo:400:kworker.0 00000100:00100000:2.0:1787853263.599211:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4920570780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874699552404480:0@lo:400:kworker.0 00000100:00100000:2.0:1787853263.599221:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49079f2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1874699552404992:0@lo:400:kworker.0 00000100:00100000:1.0:1787853263.612404:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787853263.612427:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49056dad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874699552405120:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787853263.612512:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853263.612558:0:15017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552405120 00000100:00100000:1.0:1787853263.612566:0:15017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552405120 00000100:00100000:1.0:1787853263.612641:0:15017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787853263.612651:0:15017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49056d92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874699552405120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787853263.612691:0:15017:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787853263.612775:0:15017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49056d92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874699552405120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 124us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853263.612782:0:15017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787853263.612837:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49056dad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874699552405120:0@lo:13:osp-pre-1-0.0 00000040:00080000:2.0:1787853264.108280:0:14361:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787853264.622833:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787853265.405497:0:16448:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffb906b250 20000000:00000080:0.0:1787853265.405515:0:16448:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8f4803ac5800 uarg=0000000000000000 20000000:01000000:0.0:1787853265.405556:0:16448:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787853265.405562:0:16448:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787853265.405566:0:16448:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1787853265.406421:0:16449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:0.0:1787853265.406672:0:16448:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1787853265.414985:0:16448:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787853265.415046:0:16448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f49415b9e00/0x710df789068e75b8 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853265.415068:0:16448:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f4921e21c00/0x710df789068e72af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x710df789068e72a8 expref: 18 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853265.415078:0:16448:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f49415b7600/0x710df789068e72fc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x710df789068e72f5 expref: 18 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853265.415085:0:16448:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f4921e20600/0x710df789068e7430 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x710df789068e7429 expref: 18 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853265.415096:0:16448:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f4900030200/0x710df789068e7556 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389a39 expref: 12 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853265.415104:0:16448:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f49415b8800/0x710df789068e758e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389a9b expref: 12 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853265.415112:0:16448:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f49415b9e00/0x710df789068e75b8 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853265.415171:0:16448:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f49415b8800/0x710df789068e758e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389a9b expref: 12 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853265.415190:0:16448:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f49415b8800/0x710df789068e758e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389a9b expref: 12 pid: 14323 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853265.415211:0:16448:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49417403c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16448:1874699552405248:192.168.204.1@tcp:104: 00010000:00010000:0.0:1787853265.415412:0:16448:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f4900030200/0x710df789068e7556 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389a39 expref: 12 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853265.415436:0:16448:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f4900030200/0x710df789068e7556 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389a39 expref: 12 pid: 14323 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853265.415458:0:16448:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49417421c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16448:1874699552405376:192.168.204.1@tcp:104: 00010000:00010000:0.0:1787853265.415494:0:16448:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f4921e20600/0x710df789068e7430 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x710df789068e7429 expref: 18 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853265.415502:0:16448:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f4921e20600/0x710df789068e7430 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x710df789068e7429 expref: 18 pid: 14324 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853265.415510:0:16448:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4941740780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16448:1874699552405504:0@lo:104: 00000100:00100000:0.0:1787853265.415555:0:16448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787853265.415720:0:16448:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f49415b7600/0x710df789068e72fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x710df789068e72f5 expref: 18 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853265.415740:0:16448:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f49415b7600/0x710df789068e72fc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x710df789068e72f5 expref: 18 pid: 14322 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853265.415747:0:16448:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4941740f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16448:1874699552405632:0@lo:104: 00000100:00100000:0.0:1787853265.415770:0:16448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853265.418683:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853265.418760:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526193920 00000100:00100000:2.0:1787853265.418769:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526193920 00010000:00010000:2.0:1787853265.418810:0:14314:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f49415b8800/0x710df789068e758e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389a9b expref: 13 pid: 14323 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853265.418853:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 4 00000100:00100000:2.0:1787853265.418863:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4941af30c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f34adbd4-9a89-4f2c-8086-7f2012dc74db+13:2362:x1874699526193920:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787853265.418878:0:14314:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787853265.418884:0:14314:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f49415b8800/0x710df789068e758e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389a9b expref: 13 pid: 14323 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853265.418898:0:14314:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f49415b8800/0x710df789068e758e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389a9b expref: 13 pid: 14323 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853265.418919:0:14314:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787853265.418967:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4941af30c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f34adbd4-9a89-4f2c-8086-7f2012dc74db+13:2362:x1874699526193920:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 106us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853265.418976:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 4 00010000:00010000:0.0:1787853265.419205:0:16448:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f4921e21c00/0x710df789068e72af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x710df789068e72a8 expref: 18 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853265.419218:0:16448:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f4921e21c00/0x710df789068e72af lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x710df789068e72a8 expref: 18 pid: 14323 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853265.419232:0:16448:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4941741e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16448:1874699552405760:0@lo:104: 00000100:00100000:0.0:1787853265.419270:0:16448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853265.419678:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552405504 00000100:00100000:1.0:1787853265.419684:0:14312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552405504 00000100:00100000:1.0:1787853265.419711:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552405632 00000100:00100000:1.0:1787853265.419714:0:14312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552405632 00000100:00100000:1.0:1787853265.419739:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787853265.419747:0:14312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4941742940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a76e730b-0783-4789-a5e2-a4230bb4bd66+4:16448:x1874699552405504:12345-0@lo:104: 00010000:00010000:1.0:1787853265.419758:0:14312:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.101@tcp lock: ffff8f4906502c00/0x710df789068e7429 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x710df789068e7430 expref: -99 pid: 15733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853265.419816:0:14312:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787853265.419822:0:14312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4941742940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a76e730b-0783-4789-a5e2-a4230bb4bd66+4:16448:x1874699552405504:12345-0@lo:104: Request processed in 77us (4268us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853265.419829:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787853265.419846:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787853265.419863:0:14312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4941743480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a76e730b-0783-4789-a5e2-a4230bb4bd66+3:16448:x1874699552405632:12345-0@lo:104: 00010000:00010000:1.0:1787853265.419871:0:14312:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.101@tcp lock: ffff8f492a8ad800/0x710df789068e72f5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x710df789068e72fc expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853265.419905:0:14312:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787853265.419910:0:14312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4941743480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a76e730b-0783-4789-a5e2-a4230bb4bd66+3:16448:x1874699552405632:12345-0@lo:104: Request processed in 58us (4139us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853265.419916:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1787853265.419934:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787853265.419939:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.101@tcp lock: ffff8f4906502c00/0x710df789068e7429 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x710df789068e7430 expref: -99 pid: 15733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853265.419947:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4906502c00 already unused, calling callback (ffffffffc1b55c20) 10000000:00010000:1.0:1787853265.419960:0:14317:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.101@tcp lock: ffff8f4906502c00/0x710df789068e7429 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x710df789068e7430 expref: -99 pid: 15733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853265.419969:0:14317:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.101@tcp lock: ffff8f4906502c00/0x710df789068e7429 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x710df789068e7430 expref: -99 pid: 15733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787853265.419978:0:14317:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.101@tcp lock: ffff8f4906502c00/0x710df789068e7429 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x710df789068e7430 expref: -99 pid: 15733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787853265.419984:0:14317:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787853265.420015:0:14317:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.101@tcp lock: ffff8f4906502c00/0x710df789068e7429 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x710df789068e7430 expref: -99 pid: 15733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853265.420022:0:14317:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787853265.420041:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.101@tcp lock: ffff8f4906502c00/0x710df789068e7429 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x710df789068e7430 expref: -99 pid: 15733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853265.420048:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.101@tcp lock: ffff8f4906502c00/0x710df789068e7429 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x710df789068e7430 expref: -99 pid: 15733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853265.420062:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787853265.420066:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.101@tcp lock: ffff8f492a8ad800/0x710df789068e72f5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x710df789068e72fc expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853265.420072:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f492a8ad800 already unused, calling callback (ffffffffc1b55c20) 10000000:00010000:1.0:1787853265.420075:0:14317:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.101@tcp lock: ffff8f492a8ad800/0x710df789068e72f5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x710df789068e72fc expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853265.420082:0:14317:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.101@tcp lock: ffff8f492a8ad800/0x710df789068e72f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x710df789068e72fc expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787853265.420098:0:14317:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.101@tcp lock: ffff8f492a8ad800/0x710df789068e72f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x710df789068e72fc expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787853265.420104:0:14317:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787853265.420117:0:14317:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.101@tcp lock: ffff8f492a8ad800/0x710df789068e72f5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x710df789068e72fc expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853265.420134:0:14317:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787853265.420151:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.101@tcp lock: ffff8f492a8ad800/0x710df789068e72f5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x710df789068e72fc expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853265.420158:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.101@tcp lock: ffff8f492a8ad800/0x710df789068e72f5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x710df789068e72fc expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853265.420168:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853265.420170:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853265.420172:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787853265.420193:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49056da580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a76e730b-0783-4789-a5e2-a4230bb4bd66:3307:1874699552405888:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787853265.420222:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853265.420259:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49056d9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a76e730b-0783-4789-a5e2-a4230bb4bd66:3308:1874699552406016:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787853265.420283:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853265.420312:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552405888 00000100:00100000:1.0:1787853265.420316:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552405888 00010000:00010000:1.0:1787853265.420331:0:14315:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f4921e20600/0x710df789068e7430 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x710df789068e7429 expref: 19 pid: 14324 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853265.420350:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552406016 00000100:00100000:1.0:1787853265.420354:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552406016 00010000:00010000:1.0:1787853265.420372:0:14315:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f49415b7600/0x710df789068e72fc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x710df789068e72f5 expref: 20 pid: 14322 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853265.420385:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787853265.420391:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49056db0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a76e730b-0783-4789-a5e2-a4230bb4bd66+20:3307:x1874699552405888:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787853265.420399:0:14315:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787853265.420404:0:14315:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f4921e20600/0x710df789068e7430 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x710df789068e7429 expref: 20 pid: 14324 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853265.420413:0:14315:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f4921e20600/0x710df789068e7430 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x710df789068e7429 expref: 20 pid: 14324 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853265.420427:0:14315:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787853265.420467:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49056db0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a76e730b-0783-4789-a5e2-a4230bb4bd66+20:3307:x1874699552405888:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853265.420473:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787853265.420485:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787853265.420491:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493d103050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a76e730b-0783-4789-a5e2-a4230bb4bd66+19:3308:x1874699552406016:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787853265.420498:0:14315:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787853265.420502:0:14315:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f49415b7600/0x710df789068e72fc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x710df789068e72f5 expref: 19 pid: 14322 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853265.420510:0:14315:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f49415b7600/0x710df789068e72fc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x710df789068e72f5 expref: 19 pid: 14322 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853265.420519:0:14315:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787853265.420544:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493d103050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a76e730b-0783-4789-a5e2-a4230bb4bd66+19:3308:x1874699552406016:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853265.420550:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787853265.420661:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49056d9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a76e730b-0783-4789-a5e2-a4230bb4bd66:3308:1874699552406016:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787853265.420698:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49056da580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a76e730b-0783-4789-a5e2-a4230bb4bd66:3307:1874699552405888:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787853265.421196:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787853265.421528:0:16448:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f493c154540 going to sleep for 11 seconds 00010000:00010000:0.0:1787853265.421550:0:16448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f49415b8800/0x710df789068e758e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389a9b expref: 12 pid: 14323 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853265.421563:0:16448:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49417403c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16448:1874699552405248:192.168.204.1@tcp:104: 00000100:00100000:0.0:1787853265.421595:0:16448:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49417421c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16448:1874699552405376:192.168.204.1@tcp:104: 00010000:00010000:0.0:1787853265.421604:0:16448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f4921e20600/0x710df789068e7430 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x710df789068e7429 expref: 18 pid: 14324 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853265.421613:0:16448:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4941740780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16448:1874699552405504:0@lo:104: 00010000:00010000:0.0:1787853265.421623:0:16448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f49415b7600/0x710df789068e72fc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x710df789068e72f5 expref: 17 pid: 14322 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853265.421632:0:16448:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4941740f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16448:1874699552405632:0@lo:104: 00000100:00100000:1.0:1787853265.421744:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853265.421848:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526194048 00000100:00100000:0.0:1787853265.421856:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526194048 00010000:00010000:0.0:1787853265.421893:0:14315:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f4900030200/0x710df789068e7556 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389a39 expref: 12 pid: 14323 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853265.421922:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 7 00000100:00100000:0.0:1787853265.421930:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49056da580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f34adbd4-9a89-4f2c-8086-7f2012dc74db+12:2363:x1874699526194048:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787853265.421941:0:14315:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787853265.421946:0:14315:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f4900030200/0x710df789068e7556 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389a39 expref: 12 pid: 14323 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853265.421955:0:14315:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f4900030200/0x710df789068e7556 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389a39 expref: 12 pid: 14323 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853265.421969:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f4900030200/0x710df789068e7556 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389a39 expref: 12 pid: 14323 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853265.421989:0:14315:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787853265.422032:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49056da580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f34adbd4-9a89-4f2c-8086-7f2012dc74db+11:2363:x1874699526194048:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 103us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853265.422038:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 7 00000100:00100000:2.0:1787853265.422200:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552405760 00000100:00100000:2.0:1787853265.422211:0:14313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552405760 00000100:00100000:3.0:1787853265.422288:0:14312:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787853265.422312:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787853265.422322:0:14312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493c4e0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a76e730b-0783-4789-a5e2-a4230bb4bd66+3:16448:x1874699552405760:12345-0@lo:104: 00010000:00010000:3.0:1787853265.422334:0:14312:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.101@tcp lock: ffff8f49415b9800/0x710df789068e72a8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x710df789068e72af expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853265.422388:0:14312:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787853265.422393:0:14312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493c4e0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a76e730b-0783-4789-a5e2-a4230bb4bd66+3:16448:x1874699552405760:12345-0@lo:104: Request processed in 75us (3124us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853265.422399:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1787853265.423257:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787853265.423267:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.101@tcp lock: ffff8f49415b9800/0x710df789068e72a8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x710df789068e72af expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853265.423276:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b9800 already unused, calling callback (ffffffffc1b55c20) 10000000:00010000:1.0:1787853265.423280:0:14317:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.101@tcp lock: ffff8f49415b9800/0x710df789068e72a8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x710df789068e72af expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853265.423290:0:14317:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.101@tcp lock: ffff8f49415b9800/0x710df789068e72a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x710df789068e72af expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787853265.423296:0:14317:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.101@tcp lock: ffff8f49415b9800/0x710df789068e72a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x710df789068e72af expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787853265.423301:0:14317:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787853265.423358:0:14317:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.101@tcp lock: ffff8f49415b9800/0x710df789068e72a8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x710df789068e72af expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853265.423364:0:14317:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787853265.423386:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.101@tcp lock: ffff8f49415b9800/0x710df789068e72a8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x710df789068e72af expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853265.423392:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.101@tcp lock: ffff8f49415b9800/0x710df789068e72a8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x710df789068e72af expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853265.423408:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853265.423420:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853265.423422:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787853265.423440:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49056d9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a76e730b-0783-4789-a5e2-a4230bb4bd66:3309:1874699552406144:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787853265.423553:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853265.423630:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552406144 00000100:00100000:1.0:1787853265.423636:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552406144 00010000:00010000:1.0:1787853265.423659:0:14314:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f4921e21c00/0x710df789068e72af lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x710df789068e72a8 expref: 17 pid: 14323 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853265.423685:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787853265.423692:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49056db0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a76e730b-0783-4789-a5e2-a4230bb4bd66+17:3309:x1874699552406144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787853265.423703:0:14314:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787853265.423707:0:14314:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f4921e21c00/0x710df789068e72af lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x710df789068e72a8 expref: 17 pid: 14323 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853265.423718:0:14314:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f4921e21c00/0x710df789068e72af lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x710df789068e72a8 expref: 17 pid: 14323 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853265.423800:0:14314:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f49415b9e00/0x710df789068e75b8 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853265.423809:0:14314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f49415b9e00/0x710df789068e75b8 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853265.423825:0:14314:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f49415b9e00/0x710df789068e75b8 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853265.423832:0:14314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f49415b9e00/0x710df789068e75b8 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853265.423839:0:14314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f49415b9e00/0x710df789068e75b8 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853265.424103:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f49415b9e00/0x710df789068e75b8 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853265.424110:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b9e00 already unused, calling callback (ffffffffc1528440) 00010000:00010000:1.0:1787853265.424114:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f49415b9e00/0x710df789068e75b8 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853265.424142:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f49415b9e00/0x710df789068e75b8 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853265.424153:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f49415b9e00/0x710df789068e75b8 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853265.424163:0:14314:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787853265.424206:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49056db0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a76e730b-0783-4789-a5e2-a4230bb4bd66+17:3309:x1874699552406144:12345-0@lo:103:ldlm_bl.0 Request processed in 515us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853265.424214:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787853265.424479:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49056d9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a76e730b-0783-4789-a5e2-a4230bb4bd66:3309:1874699552406144:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787853265.424626:0:16448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f4921e21c00/0x710df789068e72af lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x710df789068e72a8 expref: 16 pid: 14323 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853265.424639:0:16448:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4941741e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16448:1874699552405760:0@lo:104: 00010000:00010000:0.0:1787853265.424665:0:16448:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f49415b9e00/0x710df789068e75b8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853265.424674:0:16448:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f49415b9e00/0x710df789068e75b8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853265.424681:0:16448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f49415b9e00/0x710df789068e75b8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853265.424687:0:16448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f49415b9e00/0x710df789068e75b8 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853265.641981:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787853266.629325:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853266.629448:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526194176 00000100:00100000:0.0:1787853266.629459:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526194176 00000100:00100000:0.0:1787853266.629561:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 107 00000100:00100000:0.0:1787853266.629591:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49054a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f34adbd4-9a89-4f2c-8086-7f2012dc74db+11:13780:x1874699526194176:12345-192.168.204.1@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787853266.629611:0:14322:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853266.629634:0:14322:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f49415b8200/0x710df789068e75bf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd0a9c5079389acc expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853266.629859:0:14322:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f49415b8200/0x710df789068e75bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389acc expref: 12 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853266.629872:0:14322:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f49415b8200/0x710df789068e75bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389acc expref: 12 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853266.629884:0:14322:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49415b8200, rc 0) 00000100:00100000:0.0:1787853266.629971:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49054a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f34adbd4-9a89-4f2c-8086-7f2012dc74db+12:13780:x1874699526194176:12345-192.168.204.1@tcp:101:ll_cfg_requeue.0 Request processed in 401us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853266.629979:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 107 00000100:00100000:0.0:1787853266.637404:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853266.638135:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526194304 00000100:00100000:1.0:1787853266.638150:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526194304 00000100:00100000:1.0:1787853266.638209:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 108 00000100:00100000:1.0:1787853266.638220:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49054a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f34adbd4-9a89-4f2c-8086-7f2012dc74db+12:13780:x1874699526194304:12345-192.168.204.1@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787853266.638557:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49054a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f34adbd4-9a89-4f2c-8086-7f2012dc74db+12:13780:x1874699526194304:12345-192.168.204.1@tcp:501:ll_cfg_requeue.0 Request processed in 338us (1168us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853266.638565:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 108 00000100:00100000:1.0:1787853266.641028:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853266.641138:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526194432 00000100:00100000:2.0:1787853266.641148:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526194432 00000100:00100000:2.0:1787853266.641205:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 109 00000100:00100000:2.0:1787853266.641215:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49054a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f34adbd4-9a89-4f2c-8086-7f2012dc74db+12:13780:x1874699526194432:12345-192.168.204.1@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787853266.641443:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49054a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f34adbd4-9a89-4f2c-8086-7f2012dc74db+12:13780:x1874699526194432:12345-192.168.204.1@tcp:503:ll_cfg_requeue.0 Request processed in 228us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853266.641451:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 109 00000100:00100000:2.0:1787853266.648368:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853266.650002:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526194560 00000100:00100000:3.0:1787853266.650016:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526194560 00000100:00100000:3.0:1787853266.650093:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 110 00000100:00100000:3.0:1787853266.650115:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49054a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f34adbd4-9a89-4f2c-8086-7f2012dc74db+12:13780:x1874699526194560:12345-192.168.204.1@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787853266.650132:0:14324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853266.650153:0:14324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f4921e20800/0x710df789068e75c6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd0a9c5079389ad3 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853266.650209:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f4921e20800/0x710df789068e75c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389ad3 expref: 13 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853266.650222:0:14324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f4921e20800/0x710df789068e75c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389ad3 expref: 13 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853266.650233:0:14324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4921e20800, rc 0) 00000100:00100000:3.0:1787853266.650315:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49054a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f34adbd4-9a89-4f2c-8086-7f2012dc74db+13:13780:x1874699526194560:12345-192.168.204.1@tcp:101:ll_cfg_requeue.0 Request processed in 203us (1962us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853266.650323:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 110 00000100:00100000:2.0:1787853266.661678:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853266.662443:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526194688 00000100:00100000:0.0:1787853266.662453:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526194688 00000100:00100000:0.0:1787853266.662546:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 111 00000100:00100000:0.0:1787853266.662556:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49053f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f34adbd4-9a89-4f2c-8086-7f2012dc74db+13:13780:x1874699526194688:12345-192.168.204.1@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787853266.662910:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49053f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f34adbd4-9a89-4f2c-8086-7f2012dc74db+13:13780:x1874699526194688:12345-192.168.204.1@tcp:501:ll_cfg_requeue.0 Request processed in 354us (1242us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853266.662919:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 111 00010000:00010000:1.0:1787853266.665786:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787853266.670275:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853266.670461:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526194816 00000100:00100000:2.0:1787853266.670472:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526194816 00000100:00100000:2.0:1787853266.670531:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 112 00000100:00100000:2.0:1787853266.670541:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49053f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f34adbd4-9a89-4f2c-8086-7f2012dc74db+13:13780:x1874699526194816:12345-192.168.204.1@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787853266.670841:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49053f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f34adbd4-9a89-4f2c-8086-7f2012dc74db+13:13780:x1874699526194816:12345-192.168.204.1@tcp:503:ll_cfg_requeue.0 Request processed in 301us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853266.670849:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 112 10000000:01000000:2.0:1787853267.372262:0:14326:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787853267.372272:0:14326:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f480186a000 from 10 10000000:01000000:2.0:1787853267.372278:0:14326:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787853267.372330:0:14326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f4906502800/0x710df789068e75cd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853267.372341:0:14326:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.101@tcp lock: ffff8f4906502800/0x710df789068e75cd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853267.372352:0:14326:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: ffff8f4906502800/0x710df789068e75cd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853267.372400:0:14326:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49079f2d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a76e730b-0783-4789-a5e2-a4230bb4bd66:14326:1874699552406272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787853267.372478:0:14326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853267.375240:0:14326:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f4904c009c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787853267.378019:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552406272 00000100:00100000:0.0:1787853267.378035:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552406272 00000100:00100000:0.0:1787853267.378720:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787853267.378738:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49053f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a76e730b-0783-4789-a5e2-a4230bb4bd66+16:14326:x1874699552406272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787853267.378777:0:14322:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853267.378797:0:14322:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f49415b9400/0x710df789068e75d4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x710df789068e75cd expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853267.378844:0:14322:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f49415b9400/0x710df789068e75d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x710df789068e75cd expref: 17 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853267.378855:0:14322:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f49415b9400/0x710df789068e75d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x710df789068e75cd expref: 17 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853267.378865:0:14322:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49415b9400, rc 0) 00000100:00100000:0.0:1787853267.378946:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49053f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a76e730b-0783-4789-a5e2-a4230bb4bd66+17:14326:x1874699552406272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 217us (6468us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853267.378954:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787853267.379030:0:14326:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49079f2d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a76e730b-0783-4789-a5e2-a4230bb4bd66:14326:1874699552406272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787853267.379049:0:14326:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: ffff8f4906502800/0x710df789068e75cd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e75d4 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853267.379059:0:14326:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: ffff8f4906502800/0x710df789068e75cd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x710df789068e75d4 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853267.379148:0:14326:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4941af2580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a76e730b-0783-4789-a5e2-a4230bb4bd66:14326:1874699552406400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787853267.379183:0:14326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853267.379222:0:14326:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f49065f7240 going to sleep for 11 seconds 00000100:00100000:0.0:1787853267.379252:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552406400 00000100:00100000:0.0:1787853267.379258:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552406400 00000100:00100000:0.0:1787853267.379292:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1787853267.379300:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49053f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a76e730b-0783-4789-a5e2-a4230bb4bd66+17:14326:x1874699552406400:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787853267.379640:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49053f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a76e730b-0783-4789-a5e2-a4230bb4bd66+17:14326:x1874699552406400:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 340us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853267.379648:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1787853267.380185:0:14326:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4941af2580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a76e730b-0783-4789-a5e2-a4230bb4bd66:14326:1874699552406400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787853267.380227:0:14326:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4941af2580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a76e730b-0783-4789-a5e2-a4230bb4bd66:14326:1874699552406528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787853267.380270:0:14326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853267.380304:0:14326:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f49065f7240 going to sleep for 11 seconds 00000100:00100000:2.0:1787853267.380348:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552406528 00000100:00100000:2.0:1787853267.380354:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552406528 00000100:00100000:2.0:1787853267.380394:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1787853267.380402:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49053f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a76e730b-0783-4789-a5e2-a4230bb4bd66+17:14326:x1874699552406528:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787853267.380597:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49053f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a76e730b-0783-4789-a5e2-a4230bb4bd66+17:14326:x1874699552406528:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 195us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853267.380606:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1787853267.380628:0:14326:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4941af2580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a76e730b-0783-4789-a5e2-a4230bb4bd66:14326:1874699552406528:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787853267.381697:0:16533:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1787853267.381990:0:14326:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1787853267.382023:0:14326:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787853267.382034:0:14326:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f4906502800/0x710df789068e75cd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e75d4 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853267.382372:0:14326:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: ffff8f4906502800/0x710df789068e75cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e75d4 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787853267.382383:0:14326:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787853267.382386:0:14326:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f493483e000 from 10 10000000:01000000:1.0:1787853267.382389:0:14326:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787853267.382426:0:14326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f4900030a00/0x710df789068e75db lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853267.382434:0:14326:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.101@tcp lock: ffff8f4900030a00/0x710df789068e75db lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853267.382444:0:14326:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: ffff8f4900030a00/0x710df789068e75db lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853267.382467:0:14326:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49056dbc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a76e730b-0783-4789-a5e2-a4230bb4bd66:14326:1874699552406656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787853267.382520:0:14326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853267.382566:0:14326:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f49092d1540 going to sleep for 11 seconds 00000100:00100000:0.0:1787853267.382622:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552406656 00000100:00100000:0.0:1787853267.382629:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552406656 00000100:00100000:0.0:1787853267.382669:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1787853267.382678:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49053f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a76e730b-0783-4789-a5e2-a4230bb4bd66+17:14326:x1874699552406656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787853267.382691:0:14322:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853267.382702:0:14322:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f49415b8600/0x710df789068e75e2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x710df789068e75db expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853267.382726:0:14322:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f49415b8600/0x710df789068e75e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x710df789068e75db expref: 18 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853267.382747:0:14322:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f49415b8600/0x710df789068e75e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x710df789068e75db expref: 18 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853267.382768:0:14322:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49415b8600, rc 0) 00000100:00100000:0.0:1787853267.382822:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49053f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a76e730b-0783-4789-a5e2-a4230bb4bd66+18:14326:x1874699552406656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 146us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853267.382830:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1787853267.382852:0:14326:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49056dbc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a76e730b-0783-4789-a5e2-a4230bb4bd66:14326:1874699552406656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787853267.382880:0:14326:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: ffff8f4900030a00/0x710df789068e75db lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e75e2 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853267.382889:0:14326:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: ffff8f4900030a00/0x710df789068e75db lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x710df789068e75e2 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853267.382933:0:14326:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4941af2580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a76e730b-0783-4789-a5e2-a4230bb4bd66:14326:1874699552406784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787853267.382960:0:14326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853267.382988:0:14326:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f49065f7840 going to sleep for 11 seconds 00000100:00100000:0.0:1787853267.383302:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552406784 00000100:00100000:0.0:1787853267.383307:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552406784 00000100:00100000:1.0:1787853267.384404:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1787853267.384418:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49053f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a76e730b-0783-4789-a5e2-a4230bb4bd66+18:14326:x1874699552406784:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787853267.384721:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49053f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a76e730b-0783-4789-a5e2-a4230bb4bd66+18:14326:x1874699552406784:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 305us (1758us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853267.384729:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1787853267.385282:0:14326:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4941af2580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a76e730b-0783-4789-a5e2-a4230bb4bd66:14326:1874699552406784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787853267.386169:0:14326:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49079f21c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a76e730b-0783-4789-a5e2-a4230bb4bd66:14326:1874699552406912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787853267.386239:0:14326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853267.386287:0:14326:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f4904c00b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787853267.386446:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552406912 00000100:00100000:1.0:1787853267.386453:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552406912 00000100:00100000:1.0:1787853267.386509:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1787853267.386517:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49053f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a76e730b-0783-4789-a5e2-a4230bb4bd66+18:14326:x1874699552406912:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787853267.386721:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49053f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a76e730b-0783-4789-a5e2-a4230bb4bd66+18:14326:x1874699552406912:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 204us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853267.386728:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1787853267.387700:0:14326:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49079f21c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a76e730b-0783-4789-a5e2-a4230bb4bd66:14326:1874699552406912:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787853267.388747:0:16535:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1787853267.388846:0:14326:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1787853267.388866:0:14326:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787853267.388883:0:14326:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f4900030a00/0x710df789068e75db lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e75e2 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853267.388896:0:14326:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: ffff8f4900030a00/0x710df789068e75db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e75e2 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787853267.388908:0:14326:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787853267.388911:0:14326:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f493c6e5000 from 10 10000000:01000000:2.0:1787853267.388928:0:14326:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787853267.388969:0:14326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f4906502600/0x710df789068e75e9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853267.388976:0:14326:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.101@tcp lock: ffff8f4906502600/0x710df789068e75e9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853267.388986:0:14326:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: ffff8f4906502600/0x710df789068e75e9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853267.389013:0:14326:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49079f21c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a76e730b-0783-4789-a5e2-a4230bb4bd66:14326:1874699552407040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787853267.389183:0:14326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853267.389238:0:14326:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f4904c00b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787853267.389846:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552407040 00000100:00100000:1.0:1787853267.389857:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552407040 00000100:00100000:1.0:1787853267.389911:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1787853267.389920:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49053f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a76e730b-0783-4789-a5e2-a4230bb4bd66+18:14326:x1874699552407040:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787853267.389935:0:14323:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853267.389949:0:14323:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f4900031000/0x710df789068e75f0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x710df789068e75e9 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853267.389972:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f4900031000/0x710df789068e75f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x710df789068e75e9 expref: 19 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853267.389982:0:14323:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f4900031000/0x710df789068e75f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x710df789068e75e9 expref: 19 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853267.389991:0:14323:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4900031000, rc 0) 00000100:00100000:3.0:1787853267.390187:0:14326:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49079f21c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a76e730b-0783-4789-a5e2-a4230bb4bd66:14326:1874699552407040:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787853267.390205:0:14326:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: ffff8f4906502600/0x710df789068e75e9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e75f0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853267.390215:0:14326:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: ffff8f4906502600/0x710df789068e75e9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x710df789068e75f0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853267.390276:0:14326:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4941af1a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a76e730b-0783-4789-a5e2-a4230bb4bd66:14326:1874699552407168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787853267.391457:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49053f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a76e730b-0783-4789-a5e2-a4230bb4bd66+19:14326:x1874699552407040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1532us (2269us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853267.391466:0:14326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853267.391473:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1787853267.391516:0:14326:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f49065f73c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787853267.391516:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552407168 00000100:00100000:1.0:1787853267.391523:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552407168 00000100:00100000:1.0:1787853267.391555:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1787853267.391562:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49053f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a76e730b-0783-4789-a5e2-a4230bb4bd66+19:14326:x1874699552407168:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787853267.391816:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49053f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a76e730b-0783-4789-a5e2-a4230bb4bd66+19:14326:x1874699552407168:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 253us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853267.391833:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1787853267.392039:0:14326:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4941af1a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a76e730b-0783-4789-a5e2-a4230bb4bd66:14326:1874699552407168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787853267.392080:0:14326:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4941af1a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a76e730b-0783-4789-a5e2-a4230bb4bd66:14326:1874699552407296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787853267.392128:0:14326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853267.392155:0:14326:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f49065f73c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787853267.392408:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552407296 00000100:00100000:0.0:1787853267.392413:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552407296 00000100:00100000:0.0:1787853267.392443:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1787853267.392451:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49053f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a76e730b-0783-4789-a5e2-a4230bb4bd66+19:14326:x1874699552407296:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787853267.392647:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49053f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a76e730b-0783-4789-a5e2-a4230bb4bd66+19:14326:x1874699552407296:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 196us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853267.392654:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1787853267.392855:0:14326:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4941af1a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a76e730b-0783-4789-a5e2-a4230bb4bd66:14326:1874699552407296:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787853267.396098:0:16536:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1787853267.396509:0:14326:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1787853267.396528:0:14326:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787853267.396539:0:14326:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff8f4906502600/0x710df789068e75e9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e75f0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853267.396551:0:14326:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: ffff8f4906502600/0x710df789068e75e9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x710df789068e75f0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853267.690639:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787853267.789144:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853267.789195:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853267.789281:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526194944 00000100:00100000:2.0:1787853267.789281:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526195072 00000100:00100000:3.0:1787853267.789291:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526194944 00000100:00100000:2.0:1787853267.789291:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526195072 00000100:00100000:3.0:1787853267.789341:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 122 00000100:00100000:3.0:1787853267.789351:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493d129c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f34adbd4-9a89-4f2c-8086-7f2012dc74db+13:2365:x1874699526194944:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:2.0:1787853267.789387:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 23 00000100:00100000:2.0:1787853267.789394:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49056d9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+6:2365:x1874699526195072:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:3.0:1787853267.789425:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493d129c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f34adbd4-9a89-4f2c-8086-7f2012dc74db+13:2365:x1874699526194944:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 75us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853267.789425:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49056d9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+6:2365:x1874699526195072:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 31us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853267.789433:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 122 00000100:00100000:2.0:1787853267.789433:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 23 00000100:00080000:0.0:1787853267.789517:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787853267.793090:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853267.793144:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853267.793184:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853267.793218:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853267.793247:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853267.793273:0:15015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526195200 00000100:00100000:0.0:1787853267.793283:0:15015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526195200 00000100:00100000:0.0:1787853267.793334:0:15015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526195712 00000100:00100000:0.0:1787853267.793337:0:15015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526195712 00000100:00100000:0.0:1787853267.793368:0:15015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526195328 00000100:00100000:0.0:1787853267.793371:0:15015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526195328 00000100:00100000:0.0:1787853267.793384:0:15015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526195584 00000100:00100000:0.0:1787853267.793386:0:15015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526195584 00000100:00100000:0.0:1787853267.793403:0:15015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 9 00000100:00100000:0.0:1787853267.793413:0:15015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4941741e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+5:2365:x1874699526195200:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:0.0:1787853267.793489:0:15015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4941741e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+5:2365:x1874699526195200:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 77us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853267.793497:0:15015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 9 00000100:00100000:0.0:1787853267.793515:0:15015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 10 00000100:00100000:0.0:1787853267.793522:0:15015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4941740780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:23cfdd4f-7ffb-4b42-8d8e-04a589e53647+5:2365:x1874699526195712:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:0.0:1787853267.793547:0:15015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4941740780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:23cfdd4f-7ffb-4b42-8d8e-04a589e53647+5:2365:x1874699526195712:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 26us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853267.793553:0:15015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 10 00000100:00100000:0.0:1787853267.793565:0:15015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 11 00000100:00100000:0.0:1787853267.793608:0:15015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49417421c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+5:2365:x1874699526195328:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:0.0:1787853267.793630:0:15015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49417421c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+5:2365:x1874699526195328:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 59us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853267.793637:0:15015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 11 00000100:00100000:0.0:1787853267.793649:0:15015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 12 00000100:00100000:0.0:1787853267.793655:0:15015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49417403c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:23cfdd4f-7ffb-4b42-8d8e-04a589e53647+5:2365:x1874699526195584:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:0.0:1787853267.793676:0:15015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49417403c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:23cfdd4f-7ffb-4b42-8d8e-04a589e53647+5:2365:x1874699526195584:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 21us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853267.793682:0:15015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 12 00000100:00080000:0.0:1787853267.793699:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787853267.793710:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787853267.796235:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526195456 00000100:00100000:3.0:1787853267.796251:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526195456 00000100:00100000:3.0:1787853267.796347:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 24 00000100:00100000:3.0:1787853267.796357:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4941740f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23cfdd4f-7ffb-4b42-8d8e-04a589e53647+6:2365:x1874699526195456:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:3.0:1787853267.796491:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4941740f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23cfdd4f-7ffb-4b42-8d8e-04a589e53647+6:2365:x1874699526195456:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 135us (3346us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853267.796498:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 24 00000100:00080000:0.0:1787853267.796988:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787853268.201871:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787853268.201896:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4941af3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874699552407424:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787853268.201971:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853268.202015:0:15017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552407424 00000100:00100000:1.0:1787853268.202024:0:15017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552407424 00000100:00080000:0.0:1787853268.202104:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787853268.202165:0:15017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787853268.202175:0:15017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49079f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874699552407424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787853268.202208:0:15017:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787853268.202258:0:15017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49079f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874699552407424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853268.202266:0:15017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787853268.202284:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4941af3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874699552407424:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787853268.727085:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49056d8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874699552407552:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787853268.727167:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853268.727235:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49056da1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a76e730b-0783-4789-a5e2-a4230bb4bd66:3308:1874699552407680:0@lo:400:kworker.0 00000100:00100000:2.0:1787853268.727249:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49056dbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1874699552408064:0@lo:400:kworker.0 00000100:00100000:1.0:1787853268.727273:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853268.727303:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4934116580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1874699552408192:0@lo:400:kworker.0 00000100:00100000:2.0:1787853268.727310:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853268.727338:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853268.727342:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787853268.727351:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49056dad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874699552407936:0@lo:400:kworker.0 00000100:00100000:1.0:1787853268.727360:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787853268.727368:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49056db840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874699552407808:0@lo:400:kworker.0 00000100:00100000:2.0:1787853268.727382:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853268.727404:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853268.727423:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552408064 00000100:00100000:2.0:1787853268.727431:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552408064 00000100:00100000:1.0:1787853268.727438:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552407680 00000100:00100000:1.0:1787853268.727443:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552407680 00000100:00100000:2.0:1787853268.727483:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552408192 00000100:00100000:2.0:1787853268.727488:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552408192 00000100:00100000:1.0:1787853268.727489:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1787853268.727499:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493d12a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a76e730b-0783-4789-a5e2-a4230bb4bd66+19:3308:x1874699552407680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853268.727508:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552407936 00000100:00100000:2.0:1787853268.727512:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552407936 00000100:00100000:2.0:1787853268.727529:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787853268.727538:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49079f12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874699552408064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853268.727550:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493d12a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a76e730b-0783-4789-a5e2-a4230bb4bd66+19:3308:x1874699552407680:12345-0@lo:400:kworker.0 Request processed in 52us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853268.727590:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1787853268.727610:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49079f12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874699552408064:12345-0@lo:400:kworker.0 Request processed in 73us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853268.727619:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787853268.727642:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49056da1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a76e730b-0783-4789-a5e2-a4230bb4bd66:3308:1874699552407680:0@lo:400:kworker.0 00000100:00100000:2.0:1787853268.727652:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787853268.727683:0:15018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552407552 00000100:00100000:1.0:1787853268.727686:0:15018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552407552 00010000:00010000:3.0:1787853268.727910:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787853268.727923:0:14330:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1787853268.727932:0:14330:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1787853268.727973:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49056dbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1874699552408064:0@lo:400:kworker.0 00000100:00080000:0.0:1787853268.728448:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787853268.728464:0:15015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552407808 00000100:00100000:0.0:1787853268.728470:0:15015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552407808 00000100:00100000:0.0:1787853268.728504:0:15015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787853268.728512:0:15015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4803e64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1874699552407808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853268.728562:0:15015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4803e64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1874699552407808:12345-0@lo:400:kworker.0 Request processed in 51us (1160us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853268.728590:0:15015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787853268.728629:0:14331:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1787853268.728637:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787853268.728644:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49079f3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874699552407936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853268.728676:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49079f3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874699552407936:12345-0@lo:400:kworker.0 Request processed in 33us (1296us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853268.728682:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787853268.728715:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49056db840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874699552407808:0@lo:400:kworker.0 00000100:00100000:0.0:1787853268.729152:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49056dad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874699552407936:0@lo:400:kworker.0 00000100:00100000:2.0:1787853268.730756:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4934114b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874699552408192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853268.730860:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4934114b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874699552408192:12345-0@lo:400:kworker.0 Request processed in 3200us (3521us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853268.730870:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787853268.733276:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4934116580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1874699552408192:0@lo:400:kworker.0 00000100:00100000:1.0:1787853268.733291:0:15018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787853268.733305:0:15018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49079f03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874699552407552:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1787853268.733330:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:1.0:1787853268.733344:0:15018:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787853268.733409:0:15018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49079f03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874699552407552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (6243us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853268.733417:0:15018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787853268.733465:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49056d8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874699552407552:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787853269.336155:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853269.336343:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526195840 00000100:00100000:2.0:1787853269.336353:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526195840 00000100:00100000:2.0:1787853269.336437:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 15 00000100:00100000:2.0:1787853269.336448:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4941741680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+6:14437:x1874699526195840:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787853269.336468:0:14331:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853269.336488:0:14331:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503400/0x710df789068e75f7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c5079389ada expref: -99 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.336622:0:14331:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503c00/0x710df789068e75fe lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.336639:0:14331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503c00/0x710df789068e75fe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.336653:0:14331:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503c00/0x710df789068e75fe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.336670:0:14331:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906502a00/0x710df789068e7605 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.336677:0:14331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906502a00/0x710df789068e7605 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.336683:0:14331:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906502a00/0x710df789068e7605 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.337388:0:14331:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906502000/0x710df789068e760c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.337400:0:14331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906502000/0x710df789068e760c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.337407:0:14331:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906502000/0x710df789068e760c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787853269.337491:0:14331:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1787853269.337495:0:14331:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1787853269.337628:0:14331:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906502000/0x710df789068e760c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.337650:0:14331:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503c00/0x710df789068e75fe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.337657:0:14331:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503c00/0x710df789068e75fe lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.337663:0:14331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503c00/0x710df789068e75fe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.337669:0:14331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4906503c00 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:2.0:1787853269.337673:0:14331:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503c00/0x710df789068e75fe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.337680:0:14331:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503c00/0x710df789068e75fe lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.337692:0:14331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f4910f92600) 00010000:00010000:2.0:1787853269.337695:0:14331:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787853269.337700:0:14331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503c00/0x710df789068e75fe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.337706:0:14331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503c00/0x710df789068e75fe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.337717:0:14331:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906502a00/0x710df789068e7605 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.337723:0:14331:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906502a00/0x710df789068e7605 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.337728:0:14331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906502a00/0x710df789068e7605 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.337740:0:14331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4906502a00 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:2.0:1787853269.337743:0:14331:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906502a00/0x710df789068e7605 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.337748:0:14331:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906502a00/0x710df789068e7605 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.337756:0:14331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8f4908cc0800) 00010000:00010000:2.0:1787853269.337758:0:14331:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787853269.337761:0:14331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906502a00/0x710df789068e7605 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.337767:0:14331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906502a00/0x710df789068e7605 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787853269.338607:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787853269.339024:0:14331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503400/0x710df789068e75f7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389ada expref: 8 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.339058:0:14331:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906502000/0x710df789068e760c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389ada expref: 7 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.339066:0:14331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8f4908cc0000) 00010000:00010000:2.0:1787853269.339068:0:14331:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787853269.339071:0:14331:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4906502000, rc 0) 00000100:00100000:0.0:1787853269.339262:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4941741680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+7:14437:x1874699526195840:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 Request processed in 2814us (3114us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853269.339284:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 15 00000100:00100000:0.0:1787853269.351850:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853269.351988:0:16560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526196096 00000100:00100000:2.0:1787853269.351998:0:16560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526196096 00000100:00100000:2.0:1787853269.352090:0:16560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 16 00000100:00100000:2.0:1787853269.352100:0:16560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4941742940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+7:14437:x1874699526196096:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787853269.352138:0:16560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853269.352159:0:16560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906502200/0x710df789068e7613 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c5079389ae1 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.352258:0:16560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503600/0x710df789068e761a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.352274:0:16560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503600/0x710df789068e761a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.352287:0:16560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503600/0x710df789068e761a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.352320:0:16560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503800/0x710df789068e7621 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.352327:0:16560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503800/0x710df789068e7621 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.352333:0:16560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503800/0x710df789068e7621 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.353237:0:16560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906502c00/0x710df789068e7628 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.353252:0:16560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906502c00/0x710df789068e7628 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.353260:0:16560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906502c00/0x710df789068e7628 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787853269.353271:0:16560:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1787853269.353551:0:16560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503600/0x710df789068e761a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.353560:0:16560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503600/0x710df789068e761a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.353566:0:16560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503600/0x710df789068e761a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.353602:0:16560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4906503600 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:2.0:1787853269.353606:0:16560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503600/0x710df789068e761a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.353615:0:16560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503600/0x710df789068e761a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.353629:0:16560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8f4908cc0000) 00010000:00010000:2.0:1787853269.353632:0:16560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787853269.353637:0:16560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503600/0x710df789068e761a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.353644:0:16560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503600/0x710df789068e761a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.353659:0:16560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503800/0x710df789068e7621 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.353665:0:16560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503800/0x710df789068e7621 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.353672:0:16560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503800/0x710df789068e7621 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.353688:0:16560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4906503800 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:2.0:1787853269.353691:0:16560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503800/0x710df789068e7621 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.353699:0:16560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503800/0x710df789068e7621 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.353707:0:16560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8f4908cc0100) 00010000:00010000:2.0:1787853269.353710:0:16560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787853269.353713:0:16560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503800/0x710df789068e7621 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.353719:0:16560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503800/0x710df789068e7621 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853269.360269:0:16560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906502200/0x710df789068e7613 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389ae1 expref: 10 pid: 16560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853269.360298:0:16560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906502c00/0x710df789068e7628 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389ae1 expref: 9 pid: 16560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853269.360308:0:16560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f4908cc0700) 00010000:00010000:1.0:1787853269.360311:0:16560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787853269.360315:0:16560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4906502c00, rc 0) 00000100:00100000:1.0:1787853269.360460:0:16560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4941742940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+9:14437:x1874699526196096:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 Request processed in 8360us (8623us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1787853269.360469:0:16560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 16 00000100:00100000:1.0:1787853269.366903:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853269.367138:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526196224 00000100:00100000:3.0:1787853269.367150:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526196224 00000100:00100000:3.0:1787853269.367210:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 17 00000100:00100000:3.0:1787853269.367221:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4803e65680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+9:14437:x1874699526196224:12345-192.168.204.1@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1787853269.367346:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4803e65680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+9:14437:x1874699526196224:12345-192.168.204.1@tcp:59:lhsmtool_posix.0 Request processed in 127us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853269.367355:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 17 00000100:00100000:0.0:1787853269.428856:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853269.435857:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526196352 00000100:00100000:2.0:1787853269.435873:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526196352 00000100:00100000:2.0:1787853269.435955:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 18 00000100:00100000:2.0:1787853269.435965:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4941743480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+9:14443:x1874699526196352:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:2.0:1787853269.435990:0:14329:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853269.436024:0:14329:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503800/0x710df789068e7636 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c5079389ae8 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.436109:0:14329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503600/0x710df789068e763d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.436129:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503600/0x710df789068e763d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.436158:0:14329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503600/0x710df789068e763d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.436174:0:14329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503400/0x710df789068e7644 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.436181:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503400/0x710df789068e7644 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.436187:0:14329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503400/0x710df789068e7644 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.436470:0:14329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503600/0x710df789068e763d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.436479:0:14329:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503600/0x710df789068e763d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.436491:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503600/0x710df789068e763d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.436498:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4906503600 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:2.0:1787853269.436502:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503600/0x710df789068e763d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.436509:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503600/0x710df789068e763d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.436521:0:14329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f4910f92600) 00010000:00010000:2.0:1787853269.436525:0:14329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787853269.436529:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503600/0x710df789068e763d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.436541:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503600/0x710df789068e763d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.436555:0:14329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503400/0x710df789068e7644 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.436560:0:14329:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503400/0x710df789068e7644 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.436566:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503400/0x710df789068e7644 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.436644:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4906503400 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:2.0:1787853269.436647:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503400/0x710df789068e7644 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.436654:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503400/0x710df789068e7644 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.436663:0:14329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8f4908cc0100) 00010000:00010000:2.0:1787853269.436665:0:14329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787853269.436668:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503400/0x710df789068e7644 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.436674:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503400/0x710df789068e7644 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.436710:0:14329:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503800/0x710df789068e7636 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389ae8 expref: 10 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.436733:0:14329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f4910f92600) 00010000:00010000:2.0:1787853269.436736:0:14329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787853269.436741:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503800/0x710df789068e7636 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389ae8 expref: 10 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.436751:0:14329:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4906503800, rc 0) 00000100:00100000:2.0:1787853269.436832:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4941743480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+9:14443:x1874699526196352:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 868us (7991us total) trans 0 rc 301/301 00000100:00100000:2.0:1787853269.436841:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 18 00000100:00100000:1.0:1787853269.443214:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853269.443449:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526196480 00000100:00100000:2.0:1787853269.443460:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526196480 00000100:00100000:2.0:1787853269.443510:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 0 00000100:00100000:2.0:1787853269.443521:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4803e64780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+9:14443:x1874699526196480:12345-192.168.204.1@tcp:700:lfs.0 00000100:00100000:2.0:1787853269.443678:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4803e64780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+9:14443:x1874699526196480:12345-192.168.204.1@tcp:700:lfs.0 Request processed in 159us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853269.443686:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 0 00000100:00100000:0.0:1787853269.450736:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853269.451221:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526196736 00000100:00100000:3.0:1787853269.451238:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526196736 00000100:00100000:3.0:1787853269.451329:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 19 00000100:00100000:3.0:1787853269.451343:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4934116580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+9:14443:x1874699526196736:12345-192.168.204.1@tcp:36:lfs.0 00010000:00010000:3.0:1787853269.451432:0:14330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787853269.451469:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21600/0x710df789068e7579 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389a63 expref: 9 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853269.451499:0:14330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f4910f92600) 00010000:00010000:3.0:1787853269.451505:0:14330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787853269.452181:0:14330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e764b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853269.452202:0:14330:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503000/0x710df789068e75b1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389ac5 expref: 5 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853269.452213:0:14330:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e764b lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853269.452260:0:14330:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503000/0x710df789068e75b1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389ac5 expref: 5 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853269.452289:0:14330:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503000/0x710df789068e75b1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389ac5 expref: 5 pid: 14330 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853269.452308:0:14330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4941af1a40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14330:1874699552408320:192.168.204.1@tcp:104: 00000100:00100000:3.0:1787853269.452717:0:14330:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f49065f7600 going to sleep for 11 seconds 00000100:00100000:0.0:1787853269.457736:0:14330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4941af1a40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14330:1874699552408320:192.168.204.1@tcp:104: 00010000:00010000:0.0:1787853269.457997:0:14330:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e764b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853269.460444:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853269.461398:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526196864 00000100:00100000:1.0:1787853269.461418:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526196864 00010000:00010000:1.0:1787853269.461530:0:14316:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503000/0x710df789068e75b1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389ac5 expref: 6 pid: 14330 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853269.461636:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 9 00000100:00100000:1.0:1787853269.461658:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49092bf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:23cfdd4f-7ffb-4b42-8d8e-04a589e53647+6:2363:x1874699526196864:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787853269.461678:0:14316:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787853269.461686:0:14316:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503000/0x710df789068e75b1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389ac5 expref: 6 pid: 14330 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853269.461703:0:14316:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503000/0x710df789068e75b1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389ac5 expref: 6 pid: 14330 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853269.461739:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503000/0x710df789068e75b1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389ac5 expref: 6 pid: 14330 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853269.462087:0:14316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f4910f92600) 00010000:00010000:1.0:1787853269.462095:0:14316:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e764b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853269.462108:0:14316:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e764b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853269.462116:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e764b lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853269.462211:0:14316:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787853269.462295:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49092bf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:23cfdd4f-7ffb-4b42-8d8e-04a589e53647+5:2363:x1874699526196864:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 648us (1867us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853269.462304:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 9 00000100:00080000:0.0:1787853269.463170:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787853269.465461:0:14330:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e764b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853269.465485:0:14330:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e764b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853269.465532:0:14330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21600/0x710df789068e7652 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853269.465549:0:14330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21600/0x710df789068e7652 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853269.465566:0:14330:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21600/0x710df789068e7652 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787853269.469396:0:14330:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:3.0:1787853269.469421:0:14330:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e764b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853269.469435:0:14330:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e764b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853269.469443:0:14330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e764b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853269.469464:0:14330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4921e20c00 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:3.0:1787853269.469469:0:14330:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e764b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853269.469477:0:14330:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e764b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853269.469499:0:14330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f4910f92600) 00010000:00010000:3.0:1787853269.469502:0:14330:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787853269.469508:0:14330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e764b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853269.469515:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e764b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787853269.469545:0:14330:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002700666b reply state 00000000800378de transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21600/0x710df789068e7652 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853269.469557:0:14330:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787853269.470015:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4934116580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+10:14443:x1874699526196736:12345-192.168.204.1@tcp:36:lfs.0 Request processed in 18669us (19290us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1787853269.470027:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 19 00010000:00010000:3.0:1787853269.474349:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21600/0x710df789068e7652 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853269.474375:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21600/0x710df789068e7652 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853269.474383:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21600/0x710df789068e7652 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853269.474411:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4921e21600 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:3.0:1787853269.474417:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21600/0x710df789068e7652 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853269.474426:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21600/0x710df789068e7652 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853269.474445:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8f4910f92400) 00010000:00010000:3.0:1787853269.474449:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787853269.474454:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21600/0x710df789068e7652 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853269.474462:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21600/0x710df789068e7652 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853269.557706:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853269.557941:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526196992 00000100:00100000:2.0:1787853269.557954:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526196992 00000100:00100000:2.0:1787853269.558037:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 20 00000100:00100000:2.0:1787853269.558071:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4803e66d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+9:14451:x1874699526196992:12345-192.168.204.1@tcp:101:lctl.0 00010000:00010000:2.0:1787853269.558105:0:14329:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853269.558136:0:14329:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503800/0x710df789068e7659 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c5079389aef expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.558226:0:14329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503400/0x710df789068e7660 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.558264:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503400/0x710df789068e7660 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.558280:0:14329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503400/0x710df789068e7660 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787853269.558366:0:14329:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787853269.558371:0:14329:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:2.0:1787853269.558429:0:14329:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503400/0x710df789068e7660 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.558465:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503800/0x710df789068e7659 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389aef expref: 11 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.558490:0:14329:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503400/0x710df789068e7660 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389aef expref: 10 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.558499:0:14329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f4908cc0100) 00010000:00010000:2.0:1787853269.558502:0:14329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787853269.558507:0:14329:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4906503400, rc 0) 00000100:00100000:2.0:1787853269.558657:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4803e66d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+10:14451:x1874699526196992:12345-192.168.204.1@tcp:101:lctl.0 Request processed in 589us (971us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853269.558666:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 20 00000100:00100000:0.0:1787853269.588531:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853269.588819:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526197120 00000100:00100000:2.0:1787853269.588833:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526197120 00000100:00100000:2.0:1787853269.588931:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 21 00000100:00100000:2.0:1787853269.588944:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49092be580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23cfdd4f-7ffb-4b42-8d8e-04a589e53647+5:14452:x1874699526197120:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:2.0:1787853269.588978:0:14331:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853269.589031:0:14331:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503800/0x710df789068e7667 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c5079389af6 expref: -99 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.589137:0:14331:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503600/0x710df789068e766e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.589154:0:14331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503600/0x710df789068e766e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.589170:0:14331:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503600/0x710df789068e766e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787853269.589256:0:14331:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787853269.589260:0:14331:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:2.0:1787853269.589317:0:14331:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503600/0x710df789068e766e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.589351:0:14331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503800/0x710df789068e7667 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389af6 expref: 7 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.589375:0:14331:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503600/0x710df789068e766e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389af6 expref: 6 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.589384:0:14331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f4908cc0100) 00010000:00010000:2.0:1787853269.589388:0:14331:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787853269.589391:0:14331:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4906503600, rc 0) 00000100:00100000:2.0:1787853269.589483:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49092be580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23cfdd4f-7ffb-4b42-8d8e-04a589e53647+6:14452:x1874699526197120:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 541us (969us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853269.589492:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 21 00000100:00100000:0.0:1787853269.593435:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853269.593606:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526197248 00000100:00100000:2.0:1787853269.593651:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526197248 00000100:00100000:2.0:1787853269.593799:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 22 00000100:00100000:2.0:1787853269.593812:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49092bda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23cfdd4f-7ffb-4b42-8d8e-04a589e53647+6:14452:x1874699526197248:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:2.0:1787853269.593839:0:14329:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853269.593869:0:14329:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906502a00/0x710df789068e7675 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c5079389afd expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.593983:0:14329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503c00/0x710df789068e767c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.594001:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503c00/0x710df789068e767c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.594017:0:14329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503c00/0x710df789068e767c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.594033:0:14329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906502e00/0x710df789068e7683 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.594051:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906502e00/0x710df789068e7683 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.594058:0:14329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906502e00/0x710df789068e7683 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.598462:0:14329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503000/0x710df789068e768a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.598486:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503000/0x710df789068e768a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.598498:0:14329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503000/0x710df789068e768a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787853269.598615:0:14329:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1787853269.598620:0:14329:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787853269.598650:0:14329:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503000/0x710df789068e768a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.598665:0:14329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503c00/0x710df789068e767c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.598672:0:14329:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503c00/0x710df789068e767c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.598679:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503c00/0x710df789068e767c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.598686:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4906503c00 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:2.0:1787853269.598690:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503c00/0x710df789068e767c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.598697:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503c00/0x710df789068e767c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.598710:0:14329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f4908cc0100) 00010000:00010000:2.0:1787853269.598712:0:14329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787853269.598717:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503c00/0x710df789068e767c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.598724:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503c00/0x710df789068e767c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.598742:0:14329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906502e00/0x710df789068e7683 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.598760:0:14329:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906502e00/0x710df789068e7683 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.598765:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906502e00/0x710df789068e7683 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.598770:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4906502e00 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:2.0:1787853269.599948:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906502e00/0x710df789068e7683 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.599967:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906502e00/0x710df789068e7683 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.599985:0:14329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8f4908cc0800) 00010000:00010000:2.0:1787853269.599988:0:14329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787853269.599992:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906502e00/0x710df789068e7683 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.600867:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906502e00/0x710df789068e7683 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.600941:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906502a00/0x710df789068e7675 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389afd expref: 8 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.600958:0:14329:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503000/0x710df789068e768a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389afd expref: 7 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.600967:0:14329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8f4908cc0b00) 00010000:00010000:2.0:1787853269.600970:0:14329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787853269.600990:0:14329:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4906503000, rc 0) 00000100:00100000:2.0:1787853269.604239:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49092bda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23cfdd4f-7ffb-4b42-8d8e-04a589e53647+7:14452:x1874699526197248:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 10417us (10805us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853269.604252:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 22 00000100:00100000:1.0:1787853269.611113:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853269.612799:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526197504 00000100:00100000:2.0:1787853269.612812:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526197504 00000100:00100000:2.0:1787853269.612885:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 23 00000100:00100000:2.0:1787853269.612897:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4803e67c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23cfdd4f-7ffb-4b42-8d8e-04a589e53647+7:14452:x1874699526197504:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:2.0:1787853269.612919:0:14331:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853269.612940:0:14331:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906502a00/0x710df789068e7691 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c5079389b04 expref: -99 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787853269.613082:0:14331:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1787853269.613209:0:14331:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906502a00/0x710df789068e7691 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389b04 expref: 9 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.613225:0:14331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f4908cc0100) 00010000:00010000:2.0:1787853269.613229:0:14331:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787853269.613234:0:14331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906502a00/0x710df789068e7691 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389b04 expref: 9 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.613248:0:14331:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4906502a00, rc 0) 00000100:00100000:2.0:1787853269.613314:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4803e67c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23cfdd4f-7ffb-4b42-8d8e-04a589e53647+8:14452:x1874699526197504:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 420us (2211us total) trans 8589934595 rc 301/301 00000100:00100000:2.0:1787853269.613322:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 23 00000100:00100000:0.0:1787853269.620119:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853269.621505:0:16560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526197760 00000100:00100000:1.0:1787853269.621524:0:16560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526197760 00000100:00100000:1.0:1787853269.621671:0:16560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 24 00000100:00100000:1.0:1787853269.621685:0:16560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49092bd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:23cfdd4f-7ffb-4b42-8d8e-04a589e53647+8:14452:x1874699526197760:12345-192.168.204.1@tcp:36:lfs.0 00010000:00010000:1.0:1787853269.621766:0:16560:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787853269.622054:0:16560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503000/0x710df789068e768a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389afd expref: 8 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853269.622082:0:16560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8f4908cc0b00) 00010000:00010000:1.0:1787853269.622099:0:16560:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787853269.622138:0:16560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900031600/0x710df789068e769f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853269.622155:0:16560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900031600/0x710df789068e769f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853269.622319:0:16560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900031600/0x710df789068e769f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787853269.622780:0:16560:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e40910a2 reply state 00000000f40395ec transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900031600/0x710df789068e769f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16560 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853269.622792:0:16560:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1787853269.622810:0:16560:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:1.0:1787853269.622964:0:16560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49092bd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:23cfdd4f-7ffb-4b42-8d8e-04a589e53647+9:14452:x1874699526197760:12345-192.168.204.1@tcp:36:lfs.0 Request processed in 1279us (2860us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1787853269.622974:0:16560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 24 00010000:00010000:1.0:1787853269.627792:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900031600/0x710df789068e769f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853269.627836:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900031600/0x710df789068e769f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853269.627845:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900031600/0x710df789068e769f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853269.627851:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4900031600 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:1.0:1787853269.627857:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900031600/0x710df789068e769f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853269.627866:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900031600/0x710df789068e769f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853269.627888:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8f4914d11900) 00010000:00010000:1.0:1787853269.627891:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1787853269.627896:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900031600/0x710df789068e769f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853269.627902:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900031600/0x710df789068e769f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16560 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853269.630133:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853269.630528:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526198016 00000100:00100000:3.0:1787853269.630542:0:14332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526198016 00000100:00100000:3.0:1787853269.630746:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 2 00000100:00100000:3.0:1787853269.630760:0:14332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49092bcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:23cfdd4f-7ffb-4b42-8d8e-04a589e53647+8:14452:x1874699526198016:12345-192.168.204.1@tcp:35:lfs.0 00000100:00100000:3.0:1787853269.631185:0:14332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49092bcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:23cfdd4f-7ffb-4b42-8d8e-04a589e53647+9:14452:x1874699526198016:12345-192.168.204.1@tcp:35:lfs.0 Request processed in 426us (1069us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1787853269.631195:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 2 00000100:00100000:0.0:1787853269.643374:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853269.643543:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526198272 00000100:00100000:2.0:1787853269.643559:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526198272 00000100:00100000:2.0:1787853269.643933:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 25 00000100:00100000:2.0:1787853269.643977:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f492eb9ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23cfdd4f-7ffb-4b42-8d8e-04a589e53647+9:14452:x1874699526198272:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:2.0:1787853269.644014:0:14331:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853269.644054:0:14331:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906502a00/0x710df789068e76a6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c5079389b0b expref: -99 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.644163:0:14331:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906502e00/0x710df789068e76ad lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.644195:0:14331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906502e00/0x710df789068e76ad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.644211:0:14331:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906502e00/0x710df789068e76ad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.644241:0:14331:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503c00/0x710df789068e76b4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.644249:0:14331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503c00/0x710df789068e76b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.644257:0:14331:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503c00/0x710df789068e76b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787853269.644460:0:14331:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1787853269.644667:0:14331:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906502e00/0x710df789068e76ad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.644676:0:14331:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906502e00/0x710df789068e76ad lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.644684:0:14331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906502e00/0x710df789068e76ad lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.644706:0:14331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4906502e00 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:2.0:1787853269.644712:0:14331:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906502e00/0x710df789068e76ad lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.644721:0:14331:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906502e00/0x710df789068e76ad lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.644738:0:14331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f4908cc0100) 00010000:00010000:2.0:1787853269.644742:0:14331:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787853269.644748:0:14331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906502e00/0x710df789068e76ad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.644755:0:14331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906502e00/0x710df789068e76ad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.644784:0:14331:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503c00/0x710df789068e76b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.644792:0:14331:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503c00/0x710df789068e76b4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.644798:0:14331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503c00/0x710df789068e76b4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.644803:0:14331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4906503c00 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:2.0:1787853269.644806:0:14331:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503c00/0x710df789068e76b4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.644812:0:14331:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503c00/0x710df789068e76b4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.644833:0:14331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8f4908cc0800) 00010000:00010000:2.0:1787853269.644836:0:14331:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787853269.644839:0:14331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503c00/0x710df789068e76b4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.644846:0:14331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503c00/0x710df789068e76b4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.644901:0:14331:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906502a00/0x710df789068e76a6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389b0b expref: 11 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.644913:0:14331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f4908cc0100) 00010000:00010000:2.0:1787853269.644916:0:14331:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787853269.644920:0:14331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906502a00/0x710df789068e76a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389b0b expref: 11 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853269.644930:0:14331:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4906502a00, rc 0) 00000100:00100000:2.0:1787853269.645013:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f492eb9ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23cfdd4f-7ffb-4b42-8d8e-04a589e53647+10:14452:x1874699526198272:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 1040us (1654us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1787853269.645023:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 25 00000100:00100000:0.0:1787853269.661485:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853269.664166:0:16560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526198400 00000100:00100000:1.0:1787853269.664203:0:16560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526198400 00000100:00100000:1.0:1787853269.664331:0:16560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 26 00000100:00100000:1.0:1787853269.664348:0:16560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f492eb99a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:23cfdd4f-7ffb-4b42-8d8e-04a589e53647+10:14452:x1874699526198400:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:1.0:1787853269.664388:0:16560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853269.664424:0:16560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900031600/0x710df789068e76c2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c5079389b12 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853269.665429:0:16560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900030200/0x710df789068e76c9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853269.665474:0:16560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900030200/0x710df789068e76c9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853269.665490:0:16560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900030200/0x710df789068e76c9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787853269.665731:0:16560:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:1.0:1787853269.665736:0:16560:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787853269.665779:0:16560:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900030200/0x710df789068e76c9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853269.665825:0:16560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900031600/0x710df789068e76c2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389b12 expref: 12 pid: 16560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853269.665850:0:16560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900030200/0x710df789068e76c9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389b12 expref: 11 pid: 16560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853269.665861:0:16560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8f4914d11900) 00010000:00010000:1.0:1787853269.665864:0:16560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787853269.665868:0:16560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4900030200, rc 0) 00000100:00100000:1.0:1787853269.666473:0:16560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f492eb99a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:23cfdd4f-7ffb-4b42-8d8e-04a589e53647+11:14452:x1874699526198400:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 2124us (5004us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853269.666485:0:16560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 26 00000100:00100000:1.0:1787853269.676502:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853269.676679:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526198528 00000100:00100000:2.0:1787853269.676694:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526198528 00000100:00100000:2.0:1787853269.676788:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 3 00000100:00100000:2.0:1787853269.676804:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4803e65e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:23cfdd4f-7ffb-4b42-8d8e-04a589e53647+11:14452:x1874699526198528:12345-192.168.204.1@tcp:37:lfs.0 00000100:00100000:2.0:1787853269.701432:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4803e65e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:23cfdd4f-7ffb-4b42-8d8e-04a589e53647+11:14452:x1874699526198528:12345-192.168.204.1@tcp:37:lfs.0 Request processed in 24614us (24932us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853269.701451:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 3 00000100:00100000:0.0:1787853269.711821:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853269.712090:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526198784 00000100:00100000:3.0:1787853269.712105:0:14332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526198784 00000100:00100000:3.0:1787853269.712185:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 4 00000100:00100000:3.0:1787853269.712199:0:14332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493350e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:23cfdd4f-7ffb-4b42-8d8e-04a589e53647+11:14452:x1874699526198784:12345-192.168.204.1@tcp:35:lfs.0 00000100:00100000:3.0:1787853269.712626:0:14332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493350e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:23cfdd4f-7ffb-4b42-8d8e-04a589e53647+12:14452:x1874699526198784:12345-192.168.204.1@tcp:35:lfs.0 Request processed in 428us (820us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1787853269.712665:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 4 00010000:00010000:3.0:1787853269.745064:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787853269.833745:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853269.834101:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526198912 00000100:00100000:3.0:1787853269.834117:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526198912 00000100:00100000:3.0:1787853269.834219:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 27 00000100:00100000:3.0:1787853269.834231:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f492eb99e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+10:14458:x1874699526198912:12345-192.168.204.1@tcp:101:bash.0 00010000:00010000:3.0:1787853269.834259:0:14330:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853269.834287:0:14330:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21600/0x710df789068e76d0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c5079389b19 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853269.834378:0:14330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e76d7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853269.834395:0:14330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e76d7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853269.834409:0:14330:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e76d7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853269.834426:0:14330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20a00/0x710df789068e76de lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853269.834433:0:14330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20a00/0x710df789068e76de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853269.834439:0:14330:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20a00/0x710df789068e76de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853269.835494:0:14330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e76e5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853269.835524:0:14330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e76e5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853269.835536:0:14330:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e76e5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787853269.836561:0:14330:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787853269.836723:0:14330:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787853269.837193:0:14330:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e76e5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853269.837226:0:14330:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e76d7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853269.837234:0:14330:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e76d7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853269.837241:0:14330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e76d7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853269.837248:0:14330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4921e20c00 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:3.0:1787853269.837253:0:14330:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e76d7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853269.837261:0:14330:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e76d7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853269.837282:0:14330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f4908cc0100) 00010000:00010000:3.0:1787853269.837286:0:14330:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787853269.837292:0:14330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e76d7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853269.837322:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e76d7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853269.837346:0:14330:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20a00/0x710df789068e76de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853269.837352:0:14330:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20a00/0x710df789068e76de lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853269.837358:0:14330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20a00/0x710df789068e76de lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853269.837363:0:14330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4921e20a00 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:3.0:1787853269.837366:0:14330:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20a00/0x710df789068e76de lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853269.837374:0:14330:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20a00/0x710df789068e76de lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853269.837383:0:14330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8f4910f92400) 00010000:00010000:3.0:1787853269.837386:0:14330:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787853269.837389:0:14330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20a00/0x710df789068e76de lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853269.837394:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20a00/0x710df789068e76de lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853269.837445:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21600/0x710df789068e76d0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389b19 expref: 12 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853269.837478:0:14330:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20000/0x710df789068e76e5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389b19 expref: 11 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853269.837486:0:14330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8f4914d11900) 00010000:00010000:3.0:1787853269.837488:0:14330:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787853269.837491:0:14330:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4921e20000, rc 0) 00000100:00100000:3.0:1787853269.837675:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f492eb99e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+11:14458:x1874699526198912:12345-192.168.204.1@tcp:101:bash.0 Request processed in 3445us (3945us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853269.837687:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 27 00000100:00100000:0.0:1787853269.845305:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853269.845469:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526199168 00000100:00100000:3.0:1787853269.845482:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526199168 00000100:00100000:3.0:1787853269.845557:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 28 00000100:00100000:3.0:1787853269.845586:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f492eb992c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+11:14458:x1874699526199168:12345-192.168.204.1@tcp:101:bash.0 00010000:00010000:3.0:1787853269.845614:0:14329:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853269.845654:0:14329:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21200/0x710df789068e76ec lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c5079389b20 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853269.846399:0:14329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20200/0x710df789068e76f3 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853269.846422:0:14329:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900030200/0x710df789068e76c9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389b12 expref: 11 pid: 16560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853269.846433:0:14329:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20200/0x710df789068e76f3 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853269.846479:0:14329:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900030200/0x710df789068e76c9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389b12 expref: 11 pid: 16560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853269.846504:0:14329:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900030200/0x710df789068e76c9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389b12 expref: 11 pid: 16560 timeout: 689 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853269.846521:0:14329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4941af2d00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14329:1874699552408448:192.168.204.1@tcp:104: 00000100:00100000:3.0:1787853269.846895:0:14329:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f492064e0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787853269.869224:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853269.869306:0:14329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4941af2d00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14329:1874699552408448:192.168.204.1@tcp:104: 00010000:00010000:0.0:1787853269.869344:0:14329:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20200/0x710df789068e76f3 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853269.870738:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526199296 00000100:00100000:1.0:1787853269.870770:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526199296 00010000:00010000:1.0:1787853269.870827:0:14315:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900030200/0x710df789068e76c9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389b12 expref: 12 pid: 16560 timeout: 689 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853269.870899:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 10 00000100:00100000:1.0:1787853269.870912:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f492eb98f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:23cfdd4f-7ffb-4b42-8d8e-04a589e53647+12:2363:x1874699526199296:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787853269.870935:0:14315:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787853269.870945:0:14315:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900030200/0x710df789068e76c9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389b12 expref: 12 pid: 16560 timeout: 689 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853269.870962:0:14315:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900030200/0x710df789068e76c9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389b12 expref: 12 pid: 16560 timeout: 689 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853269.870996:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900030200/0x710df789068e76c9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389b12 expref: 12 pid: 16560 timeout: 689 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853269.871015:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8f4914d11900) 00010000:00010000:1.0:1787853269.871022:0:14315:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20200/0x710df789068e76f3 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853269.871045:0:14315:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20200/0x710df789068e76f3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853269.871057:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20200/0x710df789068e76f3 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853269.871095:0:14315:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787853269.871182:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f492eb98f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:23cfdd4f-7ffb-4b42-8d8e-04a589e53647+11:2363:x1874699526199296:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 272us (1972us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853269.871191:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 10 00010000:00010000:0.0:1787853269.871653:0:14329:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20200/0x710df789068e76f3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853269.871666:0:14329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20200/0x710df789068e76f3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853269.871708:0:14329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9800/0x710df789068e76fa lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853269.871721:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9800/0x710df789068e76fa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853269.871731:0:14329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9800/0x710df789068e76fa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853269.880838:0:14329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20a00/0x710df789068e7701 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853269.880864:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20a00/0x710df789068e7701 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853269.880878:0:14329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20a00/0x710df789068e7701 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787853269.880901:0:14329:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1787853269.880957:0:14329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20200/0x710df789068e76f3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853269.880965:0:14329:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20200/0x710df789068e76f3 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853269.880973:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20200/0x710df789068e76f3 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853269.880979:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4921e20200 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:3.0:1787853269.880984:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20200/0x710df789068e76f3 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853269.880992:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20200/0x710df789068e76f3 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853269.881020:0:14329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8f4914d11900) 00010000:00010000:3.0:1787853269.881023:0:14329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787853269.881028:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20200/0x710df789068e76f3 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853269.881055:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20200/0x710df789068e76f3 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787853269.881075:0:14329:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c09699c4 reply state 00000000c4a162c2 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9800/0x710df789068e76fa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853269.881083:0:14329:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787853269.881129:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21200/0x710df789068e76ec lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389b20 expref: 14 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853269.881145:0:14329:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20a00/0x710df789068e7701 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389b20 expref: 13 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853269.881152:0:14329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f491176b900) 00010000:00010000:3.0:1787853269.881154:0:14329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1787853269.881157:0:14329:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4921e20a00, rc 0) 00000100:00100000:3.0:1787853269.881311:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f492eb992c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+14:14458:x1874699526199168:12345-192.168.204.1@tcp:101:bash.0 Request processed in 35742us (36020us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1787853269.881384:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 28 00010000:00010000:1.0:1787853269.886910:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9800/0x710df789068e76fa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853269.886959:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9800/0x710df789068e76fa lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853269.886969:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9800/0x710df789068e76fa lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853269.886975:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b9800 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:1.0:1787853269.886982:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9800/0x710df789068e76fa lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853269.886992:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9800/0x710df789068e76fa lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853269.887017:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8f491176b500) 00010000:00010000:1.0:1787853269.887021:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787853269.887028:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9800/0x710df789068e76fa lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853269.887049:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9800/0x710df789068e76fa lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853269.899238:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853269.902167:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526199424 00000100:00100000:1.0:1787853269.902191:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526199424 00000100:00100000:1.0:1787853269.902293:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 29 00000100:00100000:1.0:1787853269.902397:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4941af3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+13:14458:x1874699526199424:12345-192.168.204.1@tcp:101:bash.0 00010000:00010000:1.0:1787853269.902438:0:14331:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853269.902469:0:14331:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900030200/0x710df789068e770f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c5079389b27 expref: -99 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853269.903835:0:14331:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900030c00/0x710df789068e7716 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853269.903866:0:14331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900030c00/0x710df789068e7716 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853269.903885:0:14331:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900030c00/0x710df789068e7716 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787853269.903947:0:14331:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1787853269.903953:0:14331:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787853269.903992:0:14331:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900030c00/0x710df789068e7716 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853269.904006:0:14331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900030c00/0x710df789068e7716 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853269.904063:0:14331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900030200/0x710df789068e770f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389b27 expref: 15 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853269.904087:0:14331:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900030c00/0x710df789068e7716 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389b27 expref: 14 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853269.904096:0:14331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f491176b900) 00010000:00010000:1.0:1787853269.904100:0:14331:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787853269.904104:0:14331:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4900030c00, rc 0) 00000100:00100000:1.0:1787853269.904207:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4941af3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+14:14458:x1874699526199424:12345-192.168.204.1@tcp:101:bash.0 Request processed in 1902us (4984us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853269.904217:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 29 00000100:00100000:0.0:1787853269.911742:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853269.911844:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526199680 00000100:00100000:3.0:1787853269.911858:0:14332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526199680 00000100:00100000:3.0:1787853269.911924:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 5 00000100:00100000:3.0:1787853269.911936:0:14332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f492eb9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+14:14458:x1874699526199680:12345-192.168.204.1@tcp:35:bash.0 00000100:00100000:3.0:1787853269.912504:0:14332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f492eb9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+15:14458:x1874699526199680:12345-192.168.204.1@tcp:35:bash.0 Request processed in 566us (776us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1787853269.912514:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 5 00000001:00080000:2.0:1787853269.921673:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934596 is committed 00000001:00080000:2.0:1787853269.921710:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934598 is committed 00000001:00080000:2.0:1787853269.921719:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934593 is committed 00000001:00080000:2.0:1787853269.921725:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000001:00080000:2.0:1787853269.921750:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934594 is committed 00000100:00100000:3.0:1787853270.049978:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853270.050117:0:16560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526199936 00000100:00100000:0.0:1787853270.050133:0:16560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526199936 00000100:00100000:0.0:1787853270.050224:0:16560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 30 00000100:00100000:0.0:1787853270.050235:0:16560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4941af12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+13:14468:x1874699526199936:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:0.0:1787853270.050261:0:16560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853270.050281:0:16560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e771d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c5079389b2e expref: -99 pid: 16560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787853270.050415:0:16560:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 7680 00010000:00010000:0.0:1787853270.050542:0:16560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e771d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389b2e expref: 15 pid: 16560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853270.050567:0:16560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f4908cc0100) 00010000:00010000:0.0:1787853270.050614:0:16560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787853270.050620:0:16560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e771d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389b2e expref: 15 pid: 16560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853270.050634:0:16560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49415b8c00, rc 0) 00000100:00100000:0.0:1787853270.050716:0:16560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4941af12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+14:14468:x1874699526199936:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 483us (756us total) trans 8589934602 rc 301/301 00000100:00100000:0.0:1787853270.050723:0:16560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 30 00000100:00100000:0.0:1787853270.057220:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853270.058054:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526200192 00000100:00100000:2.0:1787853270.058065:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526200192 00000100:00100000:2.0:1787853270.058191:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 6 00000100:00100000:2.0:1787853270.058202:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f492eb98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+14:14468:x1874699526200192:12345-192.168.204.1@tcp:35:lfs.0 00000100:00100000:2.0:1787853270.058550:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f492eb98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+15:14468:x1874699526200192:12345-192.168.204.1@tcp:35:lfs.0 Request processed in 349us (1400us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1787853270.058584:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 6 00000100:00100000:3.0:1787853270.137555:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853270.138392:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526200448 00000100:00100000:0.0:1787853270.138409:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526200448 00000100:00100000:0.0:1787853270.138496:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 31 00000100:00100000:0.0:1787853270.138508:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4941af0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+15:14471:x1874699526200448:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:0.0:1787853270.138705:0:14330:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853270.138737:0:14330:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e772b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c5079389b35 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853270.139317:0:14330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8000/0x710df789068e7732 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853270.139338:0:14330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8000/0x710df789068e7732 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853270.139354:0:14330:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8000/0x710df789068e7732 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787853270.139370:0:14330:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787853270.139847:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e772b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389b35 expref: 18 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853270.139875:0:14330:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8000/0x710df789068e7732 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389b35 expref: 17 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853270.139885:0:14330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f491176b900) 00010000:00010000:0.0:1787853270.140004:0:14330:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787853270.140010:0:14330:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49415b8000, rc 0) 00000100:00100000:0.0:1787853270.140277:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4941af0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+17:14471:x1874699526200448:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 1768us (2737us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1787853270.140289:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 31 00000100:00100000:0.0:1787853270.147470:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853270.147547:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853270.147644:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526200704 00000100:00100000:2.0:1787853270.147659:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526200704 00000100:00100000:3.0:1787853270.147666:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526200576 00000100:00100000:3.0:1787853270.147675:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526200576 00000100:00100000:2.0:1787853270.147743:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 0 00000100:00100000:2.0:1787853270.147760:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f492eb9b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+18:2363:x1874699526200704:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787853270.147787:0:14314:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787853270.147815:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8000/0x710df789068e7732 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389b35 expref: 18 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853270.147839:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f491176b900) 00010000:00010000:2.0:1787853270.147849:0:14314:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787853270.147923:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f492eb9b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+17:2363:x1874699526200704:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 170us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853270.147931:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 0 00000100:00100000:3.0:1787853270.147940:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 32 00000100:00100000:2.0:1787853270.147984:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f492eb9a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+16:14471:x1874699526200576:12345-192.168.204.1@tcp:54:lfs.0 00010000:00010000:2.0:1787853270.148079:0:14329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906502a00/0x710df789068e7740 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853270.148096:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906502a00/0x710df789068e7740 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853270.148108:0:14329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906502a00/0x710df789068e7740 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853270.148137:0:14329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906502a00/0x710df789068e7740 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853270.148144:0:14329:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906502a00/0x710df789068e7740 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853270.148151:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906502a00/0x710df789068e7740 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853270.148157:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4906502a00 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:2.0:1787853270.148161:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906502a00/0x710df789068e7740 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853270.148169:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906502a00/0x710df789068e7740 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853270.148178:0:14329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f491176b900) 00010000:00010000:2.0:1787853270.148181:0:14329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787853270.148184:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906502a00/0x710df789068e7740 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853270.148190:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906502a00/0x710df789068e7740 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853270.148313:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f492eb9a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+16:14471:x1874699526200576:12345-192.168.204.1@tcp:54:lfs.0 Request processed in 361us (860us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853270.151126:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853270.151197:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526200960 00000100:00100000:1.0:1787853270.151208:0:14332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526200960 00000100:00100000:1.0:1787853270.151280:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 7 00000100:00100000:1.0:1787853270.151291:0:14332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4941af0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+17:14471:x1874699526200960:12345-192.168.204.1@tcp:35:lfs.0 00000100:00100000:1.0:1787853270.151602:0:14332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4941af0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+18:14471:x1874699526200960:12345-192.168.204.1@tcp:35:lfs.0 Request processed in 283us (454us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1787853270.151612:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 7 00000100:00100000:2.0:1787853270.153012:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 32 00000040:00080000:0.0:1787853270.251736:0:14361:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787853270.681918:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853270.682121:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526201216 00000100:00100000:1.0:1787853270.682136:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526201216 00000100:00100000:1.0:1787853270.682231:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 33 00000100:00100000:1.0:1787853270.682242:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4941af03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+17:14502:x1874699526201216:12345-192.168.204.1@tcp:101:cat.0 00010000:00010000:1.0:1787853270.682278:0:14331:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853270.682306:0:14331:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900030200/0x710df789068e7747 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c5079389b3c expref: -99 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853270.682463:0:14331:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900031a00/0x710df789068e774e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853270.682481:0:14331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900031a00/0x710df789068e774e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853270.682498:0:14331:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900031a00/0x710df789068e774e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787853270.682512:0:14331:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787853270.682769:0:14331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900030200/0x710df789068e7747 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389b3c expref: 20 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853270.682793:0:14331:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900031a00/0x710df789068e774e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389b3c expref: 19 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853270.682825:0:14331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f491176b900) 00010000:00010000:1.0:1787853270.682828:0:14331:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787853270.682833:0:14331:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4900031a00, rc 0) 00000100:00100000:1.0:1787853270.682924:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4941af03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+19:14502:x1874699526201216:12345-192.168.204.1@tcp:101:cat.0 Request processed in 685us (1024us total) trans 8589934606 rc 0/0 00000100:00100000:1.0:1787853270.682933:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 33 00000100:00100000:3.0:1787853270.691064:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853270.691424:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526201344 00000100:00100000:1.0:1787853270.691438:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526201344 00000100:00100000:1.0:1787853270.691537:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 1 00000100:00100000:1.0:1787853270.691549:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4941af2940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+19:2363:x1874699526201344:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787853270.691593:0:14315:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787853270.691644:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900031a00/0x710df789068e774e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389b3c expref: 19 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853270.691670:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f491176b900) 00010000:00010000:1.0:1787853270.691677:0:14315:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787853270.691775:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4941af2940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+18:2363:x1874699526201344:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 228us (728us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853270.691784:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 1 00000100:00100000:3.0:1787853270.694515:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853270.695280:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526201600 00000100:00100000:1.0:1787853270.695296:0:14332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526201600 00000100:00100000:1.0:1787853270.695454:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 8 00000100:00100000:1.0:1787853270.695469:0:14332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4941af1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+18:14502:x1874699526201600:12345-192.168.204.1@tcp:35:cat.0 00000100:00100000:1.0:1787853270.697030:0:14332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4941af1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+19:14502:x1874699526201600:12345-192.168.204.1@tcp:35:cat.0 Request processed in 1542us (3633us total) trans 8589934607 rc 0/0 00000100:00100000:1.0:1787853270.697070:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 8 00010000:00010000:3.0:1787853270.765042:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787853270.800215:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853270.800323:0:16560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526201856 00000100:00100000:1.0:1787853270.800338:0:16560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526201856 00000100:00100000:1.0:1787853270.800434:0:16560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 34 00000100:00100000:1.0:1787853270.800447:0:16560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f492eb983c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+19:14508:x1874699526201856:12345-192.168.204.1@tcp:101:dd.0 00010000:00010000:1.0:1787853270.800486:0:16560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853270.800518:0:16560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900031a00/0x710df789068e775c lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c5079389b43 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853270.800746:0:16560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900030200/0x710df789068e7763 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853270.800764:0:16560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900030200/0x710df789068e7763 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853270.800780:0:16560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900030200/0x710df789068e7763 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787853270.800793:0:16560:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787853270.805588:0:16560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900031a00/0x710df789068e775c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389b43 expref: 22 pid: 16560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853270.805631:0:16560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900030200/0x710df789068e7763 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389b43 expref: 21 pid: 16560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853270.805644:0:16560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f491176b900) 00010000:00010000:1.0:1787853270.805647:0:16560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787853270.805652:0:16560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4900030200, rc 0) 00000100:00100000:1.0:1787853270.805782:0:16560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f492eb983c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+21:14508:x1874699526201856:12345-192.168.204.1@tcp:101:dd.0 Request processed in 5337us (5582us total) trans 8589934608 rc 0/0 00000100:00100000:1.0:1787853270.805793:0:16560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 34 00000100:00100000:3.0:1787853270.811405:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853270.811539:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526202112 00000100:00100000:1.0:1787853270.811553:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526202112 00000100:00100000:0.0:1787853270.812085:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 35 00000100:00100000:0.0:1787853270.812102:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4941af3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+21:14508:x1874699526202112:12345-192.168.204.1@tcp:36:dd.0 00010000:00010000:0.0:1787853270.812187:0:14331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1787853270.812225:0:14331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900030200/0x710df789068e7763 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389b43 expref: 21 pid: 16560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853270.812252:0:14331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900030c00/0x710df789068e7716 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389b27 expref: 20 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853270.812263:0:14331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f491176b900) 00010000:00010000:0.0:1787853270.812270:0:14331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787853270.812779:0:14331:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8a00/0x710df789068e7771 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853270.813228:0:14331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8a00/0x710df789068e7771 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853270.813246:0:14331:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8a00/0x710df789068e7771 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787853270.813378:0:14331:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:0.0:1787853270.813424:0:14331:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000075790db3 reply state 00000000565cc2a3 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8a00/0x710df789068e7771 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853270.813436:0:14331:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787853270.815637:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4941af3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+22:14508:x1874699526202112:12345-192.168.204.1@tcp:36:dd.0 Request processed in 3509us (4217us total) trans 8589934610 rc 0/0 00000100:00100000:0.0:1787853270.815655:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 35 00000020:00080000:0.0:1787853270.815666:0:14331:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787853270.824143:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8a00/0x710df789068e7771 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853270.824168:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8a00/0x710df789068e7771 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853270.824177:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8a00/0x710df789068e7771 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853270.824185:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b8a00 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:1.0:1787853270.824191:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8a00/0x710df789068e7771 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853270.824199:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8a00/0x710df789068e7771 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853270.824225:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f491176b900) 00010000:00010000:1.0:1787853270.824228:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787853270.824235:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8a00/0x710df789068e7771 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853270.824241:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8a00/0x710df789068e7771 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853270.931255:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853270.932153:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526202368 00000100:00100000:2.0:1787853270.932168:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526202368 00000100:00100000:2.0:1787853270.932271:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 9 00000100:00100000:2.0:1787853270.932285:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4941af2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+21:14508:x1874699526202368:12345-192.168.204.1@tcp:35:dd.0 00000100:00100000:2.0:1787853270.933466:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4941af2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+22:14508:x1874699526202368:12345-192.168.204.1@tcp:35:dd.0 Request processed in 1172us (2216us total) trans 8589934611 rc 0/0 00000100:00100000:2.0:1787853270.933484:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 9 00000100:00100000:3.0:1787853271.267808:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853271.268022:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526202496 00000100:00100000:2.0:1787853271.268037:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526202496 00000100:00100000:2.0:1787853271.268155:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 36 00000100:00100000:2.0:1787853271.268169:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4941af1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+22:14522:x1874699526202496:12345-192.168.204.1@tcp:101:stat.0 00010000:00010000:2.0:1787853271.268208:0:14329:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853271.268244:0:14329:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906502a00/0x710df789068e7778 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c5079389b4a expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853271.268345:0:14329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503c00/0x710df789068e777f lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853271.268364:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503c00/0x710df789068e777f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853271.268379:0:14329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503c00/0x710df789068e777f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853271.268427:0:14329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906502e00/0x710df789068e7786 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853271.268435:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906502e00/0x710df789068e7786 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853271.268443:0:14329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906502e00/0x710df789068e7786 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787853271.268830:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787853271.268928:0:14329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503800/0x710df789068e778d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853271.268939:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503800/0x710df789068e778d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853271.268947:0:14329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503800/0x710df789068e778d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787853271.269018:0:14329:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1787853271.269023:0:14329:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787853271.269077:0:14329:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503800/0x710df789068e778d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853271.269091:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503800/0x710df789068e778d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853271.269102:0:14329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503c00/0x710df789068e777f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853271.269110:0:14329:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503c00/0x710df789068e777f lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853271.269131:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503c00/0x710df789068e777f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853271.269138:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4906503c00 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:2.0:1787853271.269144:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503c00/0x710df789068e777f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853271.269153:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503c00/0x710df789068e777f lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853271.269168:0:14329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8f4914d11900) 00010000:00010000:2.0:1787853271.269171:0:14329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787853271.269177:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503c00/0x710df789068e777f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853271.269184:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503c00/0x710df789068e777f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853271.269202:0:14329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906502e00/0x710df789068e7786 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853271.269209:0:14329:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906502e00/0x710df789068e7786 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853271.269215:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906502e00/0x710df789068e7786 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853271.269221:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4906502e00 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:2.0:1787853271.269224:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906502e00/0x710df789068e7786 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853271.269240:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906502e00/0x710df789068e7786 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853271.269248:0:14329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8f4908cc0800) 00010000:00010000:2.0:1787853271.269250:0:14329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787853271.269253:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906502e00/0x710df789068e7786 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853271.269259:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906502e00/0x710df789068e7786 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853271.269303:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906502a00/0x710df789068e7778 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389b4a expref: 24 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853271.269319:0:14329:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503800/0x710df789068e778d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389b4a expref: 23 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853271.269326:0:14329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f491176b900) 00010000:00010000:2.0:1787853271.269329:0:14329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787853271.269331:0:14329:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4906503800, rc 0) 00000100:00100000:2.0:1787853271.269425:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4941af1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+23:14522:x1874699526202496:12345-192.168.204.1@tcp:101:stat.0 Request processed in 1259us (1634us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853271.269436:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 36 00000100:00100000:0.0:1787853271.344497:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853271.344655:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526202752 00000100:00100000:1.0:1787853271.344671:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526202752 00000100:00100000:1.0:1787853271.344770:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 37 00000100:00100000:1.0:1787853271.344945:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f492eb99680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+23:14528:x1874699526202752:12345-192.168.204.1@tcp:36:truncate.0 00010000:00010000:1.0:1787853271.345046:0:14330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787853271.345093:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503800/0x710df789068e778d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389b4a expref: 23 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853271.345118:0:14330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f491176b900) 00010000:00010000:1.0:1787853271.345125:0:14330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787853271.345481:0:14330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900031a00/0x710df789068e7794 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853271.345498:0:14330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900031a00/0x710df789068e7794 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853271.345509:0:14330:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900031a00/0x710df789068e7794 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787853271.345700:0:14330:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934612 00000004:00010000:1.0:1787853271.345734:0:14330:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005f10ad18 reply state 00000000da4a791e transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900031a00/0x710df789068e7794 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853271.346236:0:14330:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787853271.346487:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f492eb99680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+25:14528:x1874699526202752:12345-192.168.204.1@tcp:36:truncate.0 Request processed in 1685us (2002us total) trans 8589934613 rc 0/0 00000100:00100000:1.0:1787853271.346496:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 37 00000020:00080000:1.0:1787853271.346502:0:14330:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787853271.351336:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900031a00/0x710df789068e7794 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853271.351422:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900031a00/0x710df789068e7794 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853271.351461:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900031a00/0x710df789068e7794 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853271.351469:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4900031a00 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:1.0:1787853271.351475:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900031a00/0x710df789068e7794 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853271.351486:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900031a00/0x710df789068e7794 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853271.351508:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f491176b900) 00010000:00010000:1.0:1787853271.351511:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787853271.351517:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900031a00/0x710df789068e7794 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853271.351524:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900031a00/0x710df789068e7794 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853271.549540:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853271.549723:0:16560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526202880 00000100:00100000:1.0:1787853271.549737:0:16560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526202880 00000100:00100000:1.0:1787853271.549819:0:16560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 38 00000100:00100000:1.0:1787853271.549832:0:16560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f492eb9bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+24:14542:x1874699526202880:12345-192.168.204.1@tcp:101:stat.0 00010000:00010000:1.0:1787853271.549867:0:16560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853271.549905:0:16560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900031a00/0x710df789068e779b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c5079389b51 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853271.550011:0:16560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900031800/0x710df789068e77a2 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853271.550030:0:16560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900031800/0x710df789068e77a2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853271.550068:0:16560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900031800/0x710df789068e77a2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853271.550156:0:16560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900031e00/0x710df789068e77a9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853271.550165:0:16560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900031e00/0x710df789068e77a9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853271.550173:0:16560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900031e00/0x710df789068e77a9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853271.553633:0:16560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900030e00/0x710df789068e77b0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853271.553671:0:16560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900030e00/0x710df789068e77b0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853271.553688:0:16560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900030e00/0x710df789068e77b0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787853271.553754:0:16560:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00000004:00200000:1.0:1787853271.553760:0:16560:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787853271.553794:0:16560:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900030e00/0x710df789068e77b0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853271.553808:0:16560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900030e00/0x710df789068e77b0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853271.553821:0:16560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900031800/0x710df789068e77a2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853271.553853:0:16560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900031800/0x710df789068e77a2 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853271.553861:0:16560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900031800/0x710df789068e77a2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853271.553868:0:16560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4900031800 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:1.0:1787853271.553874:0:16560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900031800/0x710df789068e77a2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853271.553884:0:16560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900031800/0x710df789068e77a2 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853271.553900:0:16560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8f4914d11900) 00010000:00010000:1.0:1787853271.553903:0:16560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787853271.553910:0:16560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900031800/0x710df789068e77a2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853271.553917:0:16560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900031800/0x710df789068e77a2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853271.553937:0:16560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900031e00/0x710df789068e77a9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853271.553943:0:16560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900031e00/0x710df789068e77a9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853271.553950:0:16560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900031e00/0x710df789068e77a9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853271.553955:0:16560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4900031e00 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:1.0:1787853271.553965:0:16560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900031e00/0x710df789068e77a9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853271.553973:0:16560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900031e00/0x710df789068e77a9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853271.553983:0:16560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8f4914d11100) 00010000:00010000:1.0:1787853271.553986:0:16560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787853271.553989:0:16560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900031e00/0x710df789068e77a9 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853271.553996:0:16560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900031e00/0x710df789068e77a9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853271.554064:0:16560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900031a00/0x710df789068e779b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389b51 expref: 26 pid: 16560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853271.554082:0:16560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900030e00/0x710df789068e77b0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389b51 expref: 25 pid: 16560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853271.554091:0:16560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f491176b900) 00010000:00010000:1.0:1787853271.554093:0:16560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787853271.554096:0:16560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4900030e00, rc 0) 00000100:00100000:1.0:1787853271.554229:0:16560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f492eb9bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+25:14542:x1874699526202880:12345-192.168.204.1@tcp:101:stat.0 Request processed in 4397us (4701us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853271.554240:0:16560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 38 00000100:00100000:3.0:1787853271.662075:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853271.662251:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526203136 00000100:00100000:0.0:1787853271.662265:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526203136 00000100:00100000:0.0:1787853271.662355:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 39 00000100:00100000:0.0:1787853271.662369:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4941af3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+25:14552:x1874699526203136:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:0.0:1787853271.662401:0:14331:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853271.662432:0:14331:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9000/0x710df789068e77b7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c5079389b58 expref: -99 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787853271.662683:0:14331:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 7680 00010000:00010000:0.0:1787853271.663436:0:14331:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9000/0x710df789068e77b7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389b58 expref: 27 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853271.663457:0:14331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f4908cc0100) 00010000:00010000:0.0:1787853271.663460:0:14331:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787853271.663466:0:14331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9000/0x710df789068e77b7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389b58 expref: 27 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853271.663508:0:14331:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49415b9000, rc 0) 00000100:00100000:0.0:1787853271.663823:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4941af3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+26:14552:x1874699526203136:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 1454us (1765us total) trans 8589934614 rc 301/301 00000100:00100000:0.0:1787853271.663832:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 39 00000100:00100000:3.0:1787853271.671084:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853271.671300:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526203392 00000100:00100000:2.0:1787853271.671314:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526203392 00000100:00100000:2.0:1787853271.671408:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 10 00000100:00100000:2.0:1787853271.671422:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493350f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+26:14552:x1874699526203392:12345-192.168.204.1@tcp:35:lfs.0 00000100:00100000:2.0:1787853271.672323:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493350f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+27:14552:x1874699526203392:12345-192.168.204.1@tcp:35:lfs.0 Request processed in 898us (1253us total) trans 8589934615 rc 0/0 00000100:00100000:2.0:1787853271.672336:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 10 00000100:00100000:3.0:1787853271.765853:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853271.766244:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526203648 00000100:00100000:2.0:1787853271.766259:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526203648 00000100:00100000:2.0:1787853271.766361:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 40 00000100:00100000:2.0:1787853271.766374:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4941af2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+27:14558:x1874699526203648:12345-192.168.204.1@tcp:101:bash.0 00010000:00010000:2.0:1787853271.766411:0:14329:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853271.766439:0:14329:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906502a00/0x710df789068e77c5 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c5079389b5f expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853271.766682:0:14329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906502e00/0x710df789068e77cc lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853271.766701:0:14329:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20a00/0x710df789068e7701 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389b20 expref: 28 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853271.766710:0:14329:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900030e00/0x710df789068e77b0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389b51 expref: 28 pid: 16560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853271.766717:0:14329:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906502e00/0x710df789068e77cc lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853271.766774:0:14329:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900030e00/0x710df789068e77b0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389b51 expref: 28 pid: 16560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853271.766789:0:14329:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900030e00/0x710df789068e77b0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389b51 expref: 28 pid: 16560 timeout: 691 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853271.766820:0:14329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49079f1a40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14329:1874699552408576:192.168.204.1@tcp:104: 00010000:00010000:2.0:1787853271.766986:0:14329:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20a00/0x710df789068e7701 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389b20 expref: 28 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853271.767006:0:14329:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20a00/0x710df789068e7701 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389b20 expref: 28 pid: 14329 timeout: 691 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853271.767017:0:14329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49079f1680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14329:1874699552408704:192.168.204.1@tcp:104: 00000100:00100000:2.0:1787853271.767042:0:14329:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f4904c000c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787853271.771240:0:14329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49079f1a40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14329:1874699552408576:192.168.204.1@tcp:104: 00000100:00100000:2.0:1787853271.771264:0:14329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49079f1680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14329:1874699552408704:192.168.204.1@tcp:104: 00010000:00010000:2.0:1787853271.771306:0:14329:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906502e00/0x710df789068e77cc lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853271.775745:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853271.776020:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526203776 00000100:00100000:2.0:1787853271.776034:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526203776 00010000:00010000:2.0:1787853271.776103:0:14314:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900030e00/0x710df789068e77b0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389b51 expref: 29 pid: 16560 timeout: 691 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853271.776155:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 11 00000100:00100000:2.0:1787853271.776166:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493d101450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+29:2362:x1874699526203776:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787853271.776186:0:14314:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787853271.776194:0:14314:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900030e00/0x710df789068e77b0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389b51 expref: 29 pid: 16560 timeout: 691 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853271.776232:0:14314:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900030e00/0x710df789068e77b0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389b51 expref: 29 pid: 16560 timeout: 691 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853271.776259:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900030e00/0x710df789068e77b0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389b51 expref: 29 pid: 16560 timeout: 691 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853271.776280:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f491176b900) 00010000:00010000:2.0:1787853271.776286:0:14314:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906502e00/0x710df789068e77cc lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853271.776296:0:14314:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906502e00/0x710df789068e77cc lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853271.776303:0:14314:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787853271.776368:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493d101450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+28:2362:x1874699526203776:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 204us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853271.776376:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 11 00000100:00100000:3.0:1787853271.780415:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00010000:00010000:3.0:1787853271.786694:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787853271.787057:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526203904 00000100:00100000:1.0:1787853271.787073:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526203904 00010000:00010000:1.0:1787853271.787160:0:14316:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20a00/0x710df789068e7701 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389b20 expref: 28 pid: 14329 timeout: 691 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853271.787248:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 12 00000100:00100000:1.0:1787853271.787260:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4941af0b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+28:2362:x1874699526203904:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787853271.787285:0:14316:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787853271.787294:0:14316:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20a00/0x710df789068e7701 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389b20 expref: 28 pid: 14329 timeout: 691 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853271.787310:0:14316:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20a00/0x710df789068e7701 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389b20 expref: 28 pid: 14329 timeout: 691 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853271.787337:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20a00/0x710df789068e7701 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389b20 expref: 28 pid: 14329 timeout: 691 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853271.787362:0:14316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f491176b900) 00010000:00010000:1.0:1787853271.787369:0:14316:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906502e00/0x710df789068e77cc lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853271.787380:0:14316:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906502e00/0x710df789068e77cc lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853271.787389:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906502e00/0x710df789068e77cc lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853271.787432:0:14316:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787853271.787519:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4941af0b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+27:2362:x1874699526203904:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 261us (7122us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853271.787527:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 12 00010000:00010000:0.0:1787853271.787974:0:14329:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906502e00/0x710df789068e77cc lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853271.787984:0:14329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906502e00/0x710df789068e77cc lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787853271.788020:0:14329:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00010000:00010000:0.0:1787853271.788255:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906502a00/0x710df789068e77c5 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389b5f expref: 28 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853271.788277:0:14329:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906502e00/0x710df789068e77cc lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389b5f expref: 27 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853271.788286:0:14329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f491176b900) 00010000:00010000:0.0:1787853271.788289:0:14329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787853271.788292:0:14329:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4906502e00, rc 0) 00000100:00100000:0.0:1787853271.788351:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4941af2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+27:14558:x1874699526203648:12345-192.168.204.1@tcp:101:bash.0 Request processed in 21980us (22516us total) trans 8589934616 rc 0/0 00000100:00100000:0.0:1787853271.788360:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 40 00000100:00100000:3.0:1787853271.797408:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853271.797530:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526204160 00000100:00100000:1.0:1787853271.797564:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526204160 00000100:00100000:1.0:1787853271.797678:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 41 00000100:00100000:1.0:1787853271.797690:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4941af30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+27:14558:x1874699526204160:12345-192.168.204.1@tcp:36:bash.0 00010000:00010000:1.0:1787853271.798076:0:14330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900031800/0x710df789068e77da lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853271.798099:0:14330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900031800/0x710df789068e77da lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853271.798113:0:14330:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900031800/0x710df789068e77da lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787853271.798179:0:14330:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000004:00010000:1.0:1787853271.798206:0:14330:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c57a291e reply state 000000007a12bba7 transno 8589934618 ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900031800/0x710df789068e77da lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853271.798216:0:14330:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787853271.798402:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4941af30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+30:14558:x1874699526204160:12345-192.168.204.1@tcp:36:bash.0 Request processed in 712us (1009us total) trans 8589934618 rc 0/0 00000100:00100000:1.0:1787853271.798411:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 41 00000020:00080000:1.0:1787853271.798418:0:14330:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787853271.800681:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900031800/0x710df789068e77da lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853271.800703:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900031800/0x710df789068e77da lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853271.800741:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900031800/0x710df789068e77da lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853271.800748:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4900031800 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:0.0:1787853271.800754:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900031800/0x710df789068e77da lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853271.800762:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900031800/0x710df789068e77da lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853271.800786:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f491176b900) 00010000:00010000:0.0:1787853271.800789:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787853271.800795:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900031800/0x710df789068e77da lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853271.800801:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900031800/0x710df789068e77da lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853271.802107:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853271.803707:0:16560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526204288 00000100:00100000:1.0:1787853271.803725:0:16560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526204288 00000100:00100000:1.0:1787853271.803818:0:16560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 42 00000100:00100000:1.0:1787853271.803830:0:16560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4941af21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+29:14558:x1874699526204288:12345-192.168.204.1@tcp:101:bash.0 00010000:00010000:1.0:1787853271.803863:0:16560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853271.803892:0:16560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900031e00/0x710df789068e77e1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c5079389b66 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853271.803982:0:16560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900031e00/0x710df789068e77e1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389b66 expref: 30 pid: 16560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853271.804042:0:16560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900031e00/0x710df789068e77e1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389b66 expref: 30 pid: 16560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853271.804068:0:16560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f491176b900) 00010000:00010000:1.0:1787853271.804071:0:16560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787853271.804075:0:16560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4900031e00, rc 0) 00000100:00100000:1.0:1787853271.804164:0:16560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4941af21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+30:14558:x1874699526204288:12345-192.168.204.1@tcp:101:bash.0 Request processed in 336us (2078us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853271.804173:0:16560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 42 00000100:00100000:3.0:1787853271.816026:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853271.817226:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526204416 00000100:00100000:1.0:1787853271.817248:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526204416 00000100:00100000:1.0:1787853271.817353:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 43 00000100:00100000:1.0:1787853271.817366:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4941af1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+30:14558:x1874699526204416:12345-192.168.204.1@tcp:101:bash.0 00010000:00010000:1.0:1787853271.817395:0:14330:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853271.817427:0:14330:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900030e00/0x710df789068e77e8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c5079389b6d expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853271.817630:0:14330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900031a00/0x710df789068e77ef lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853271.817648:0:14330:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906502e00/0x710df789068e77cc lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389b5f expref: 31 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853271.817659:0:14330:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900031a00/0x710df789068e77ef lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853271.817706:0:14330:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906502e00/0x710df789068e77cc lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389b5f expref: 31 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853271.817731:0:14330:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906502e00/0x710df789068e77cc lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389b5f expref: 31 pid: 14329 timeout: 691 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853271.817754:0:14330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4803e64f00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14330:1874699552408832:192.168.204.1@tcp:104: 00000100:00100000:1.0:1787853271.817878:0:14330:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f49092d1a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787853271.823376:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853271.823864:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526204544 00000100:00100000:2.0:1787853271.823879:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526204544 00010000:00010000:2.0:1787853271.823941:0:14315:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906502e00/0x710df789068e77cc lrc: 5/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389b5f expref: 32 pid: 14329 timeout: 691 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853271.823993:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 13 00000100:00100000:2.0:1787853271.824015:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4941af2940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+32:2362:x1874699526204544:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787853271.824037:0:14315:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787853271.824045:0:14315:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906502e00/0x710df789068e77cc lrc: 5/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389b5f expref: 32 pid: 14329 timeout: 691 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853271.824086:0:14315:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906502e00/0x710df789068e77cc lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389b5f expref: 32 pid: 14329 timeout: 691 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853271.824118:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f491176b900) 00010000:00010000:2.0:1787853271.824124:0:14315:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900031a00/0x710df789068e77ef lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853271.824135:0:14315:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900031a00/0x710df789068e77ef lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853271.824144:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900031a00/0x710df789068e77ef lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853271.824169:0:14315:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787853271.824255:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4941af2940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+32:2362:x1874699526204544:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 242us (894us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853271.824265:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 13 00010000:00010000:1.0:1787853271.826267:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906502e00/0x710df789068e77cc lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389b5f expref: 31 pid: 14329 timeout: 691 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853271.826301:0:14330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4803e64f00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14330:1874699552408832:192.168.204.1@tcp:104: 00010000:00010000:1.0:1787853271.826328:0:14330:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900031a00/0x710df789068e77ef lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853271.826339:0:14330:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900031a00/0x710df789068e77ef lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853271.826345:0:14330:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900031a00/0x710df789068e77ef lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787853271.826413:0:14330:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1787853271.826419:0:14330:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787853271.826451:0:14330:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900031a00/0x710df789068e77ef lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853271.826496:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900030e00/0x710df789068e77e8 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389b6d expref: 31 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853271.826514:0:14330:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900031a00/0x710df789068e77ef lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389b6d expref: 30 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853271.826550:0:14330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f491176b900) 00010000:00010000:1.0:1787853271.826554:0:14330:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787853271.826559:0:14330:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4900031a00, rc 0) 00000100:00100000:1.0:1787853271.826707:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4941af1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+30:14558:x1874699526204416:12345-192.168.204.1@tcp:101:bash.0 Request processed in 9343us (10696us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853271.826718:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 43 00000100:00100000:3.0:1787853271.833511:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853271.833871:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526204800 00000100:00100000:2.0:1787853271.833886:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526204800 00000100:00100000:2.0:1787853271.833978:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 2 00000100:00100000:2.0:1787853271.833991:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4941af0f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+30:14558:x1874699526204800:12345-192.168.204.1@tcp:103:bash.0 00010000:00010000:2.0:1787853271.834026:0:14314:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1787853271.834064:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900031a00/0x710df789068e77ef lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389b6d expref: 30 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853271.834109:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900031e00/0x710df789068e77e1 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389b66 expref: 29 pid: 16560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853271.834312:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f491176b900) 00010000:00010000:2.0:1787853271.834326:0:14314:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787853271.834410:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4941af0f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+28:14558:x1874699526204800:12345-192.168.204.1@tcp:103:bash.0 Request processed in 422us (916us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853271.834418:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 2 00000100:00100000:3.0:1787853271.838185:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853271.838393:0:16560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526204928 00000100:00100000:1.0:1787853271.838407:0:16560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526204928 00000100:00100000:1.0:1787853271.838486:0:16560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 44 00000100:00100000:1.0:1787853271.838499:0:16560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4941af1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+28:14558:x1874699526204928:12345-192.168.204.1@tcp:58:bash.0 00010000:00010000:1.0:1787853271.838845:0:16560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900030e00/0x710df789068e77f6 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853271.838867:0:16560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900030e00/0x710df789068e77f6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853271.838881:0:16560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900030e00/0x710df789068e77f6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16560 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787853271.842796:0:16560:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787853271.842988:0:16560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:0.0:1787853271.843092:0:16560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:0.0:1787853271.843272:0:16560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4941af1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+28:14558:x1874699526204928:12345-192.168.204.1@tcp:58:bash.0 Request processed in 4767us (5092us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853271.843288:0:16560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 44 00000100:00100000:0.0:1787853271.845948:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853271.846225:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526205056 00000100:00100000:2.0:1787853271.846238:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526205056 00000100:00100000:2.0:1787853271.846362:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 45 00000100:00100000:2.0:1787853271.846374:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f492eb98780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+28:14558:x1874699526205056:12345-192.168.204.1@tcp:101:bash.0 00010000:00010000:2.0:1787853271.846404:0:14331:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853271.846431:0:14331:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503c00/0x710df789068e77fd lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c5079389b74 expref: -99 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853271.846515:0:14331:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900030e00/0x710df789068e77f6 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853271.846529:0:14331:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503c00/0x710df789068e77fd lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389b74 expref: 29 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853271.846554:0:14331:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900030e00/0x710df789068e77f6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 16560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853271.846683:0:14331:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503c00/0x710df789068e77fd lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389b74 expref: 29 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853271.846702:0:14331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f4914d11100) 00010000:00010000:2.0:1787853271.846722:0:14331:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787853271.846741:0:14331:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503c00/0x710df789068e77fd lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389b74 expref: 29 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853271.846750:0:14331:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4906503c00, rc 0) 00000100:00100000:2.0:1787853271.846875:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f492eb98780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+29:14558:x1874699526205056:12345-192.168.204.1@tcp:101:bash.0 Request processed in 503us (941us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853271.846882:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 45 00000040:00080000:2.0:1787853272.300481:0:14361:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787853272.300491:0:14361:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787853272.300541:0:14361:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1787853272.300551:0:14361:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1787853272.300759:0:14361:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49079f1680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14361:1874699552408960:192.168.204.1@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787853272.300889:0:14361:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f4904c00d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787853272.329356:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853272.329470:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526205184 00000100:00100000:1.0:1787853272.329482:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526205184 00000100:00100000:1.0:1787853272.329548:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 0 00000100:00100000:1.0:1787853272.329560:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f492eb98b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+30:14560:x1874699526205184:12345-192.168.204.1@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1787853272.329694:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f492eb98b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+30:14560:x1874699526205184:12345-192.168.204.1@tcp:900:lhsmtool_posix.0 Request processed in 135us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853272.329702:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 0 00000100:00100000:3.0:1787853272.333690:0:14361:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49079f1680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14361:1874699552408960:192.168.204.1@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787853272.335198:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853272.335636:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526205312 00000100:00100000:1.0:1787853272.335649:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526205312 00000100:00100000:1.0:1787853272.335737:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 46 00000100:00100000:1.0:1787853272.335747:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49079f1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+29:14560:x1874699526205312:12345-192.168.204.1@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787853272.335795:0:14329:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787853272.335948:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49079f1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+29:14560:x1874699526205312:12345-192.168.204.1@tcp:53:lhsmtool_posix.0 Request processed in 190us (751us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853272.335956:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 46 00000100:00100000:1.0:1787853272.368098:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853272.381273:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526205440 00000100:00100000:3.0:1787853272.381298:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526205440 00000100:00100000:3.0:1787853272.381411:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 47 00000100:00100000:3.0:1787853272.381423:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4803e64f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+29:14560:x1874699526205440:12345-192.168.204.1@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787853272.381538:0:14330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21200/0x710df789068e7804 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853272.381561:0:14330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21200/0x710df789068e7804 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853272.381598:0:14330:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21200/0x710df789068e7804 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853272.381784:0:14330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21600/0x710df789068e780b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853272.381812:0:14330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21600/0x710df789068e780b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853272.381828:0:14330:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21600/0x710df789068e780b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853272.381865:0:14330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20200/0x710df789068e7812 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853272.381874:0:14330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20200/0x710df789068e7812 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853272.381880:0:14330:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20200/0x710df789068e7812 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787853272.381969:0:14330:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1787853272.381975:0:14330:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787853272.382011:0:14330:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20200/0x710df789068e7812 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853272.382026:0:14330:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21200/0x710df789068e7804 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853272.382032:0:14330:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21200/0x710df789068e7804 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853272.382040:0:14330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21200/0x710df789068e7804 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853272.382047:0:14330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4921e21200 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:3.0:1787853272.382052:0:14330:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21200/0x710df789068e7804 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853272.382072:0:14330:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21200/0x710df789068e7804 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853272.382665:0:14330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f4908cc0700) 00010000:00010000:3.0:1787853272.382670:0:14330:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787853272.382676:0:14330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21200/0x710df789068e7804 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853272.382683:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21200/0x710df789068e7804 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853272.382767:0:14330:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21600/0x710df789068e780b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853272.382786:0:14330:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21600/0x710df789068e780b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853272.382792:0:14330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21600/0x710df789068e780b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853272.382796:0:14330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4921e21600 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:3.0:1787853272.382799:0:14330:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21600/0x710df789068e780b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853272.382805:0:14330:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21600/0x710df789068e780b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853272.382813:0:14330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff8f4910f92400) 00010000:00010000:3.0:1787853272.382815:0:14330:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787853272.382817:0:14330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21600/0x710df789068e780b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853272.382823:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21600/0x710df789068e780b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853272.382838:0:14330:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20200/0x710df789068e7812 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853272.382844:0:14330:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20200/0x710df789068e7812 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853272.382849:0:14330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20200/0x710df789068e7812 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853272.382854:0:14330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4921e20200 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:3.0:1787853272.382862:0:14330:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20200/0x710df789068e7812 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853272.382868:0:14330:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20200/0x710df789068e7812 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853272.382875:0:14330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f4914d11100) 00010000:00010000:3.0:1787853272.382878:0:14330:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787853272.382881:0:14330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20200/0x710df789068e7812 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853272.382887:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20200/0x710df789068e7812 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853272.382977:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4803e64f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+29:14560:x1874699526205440:12345-192.168.204.1@tcp:34:lhsmtool_posix.0 Request processed in 1552us (14894us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853272.383004:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 47 00000100:00100000:2.0:1787853272.399893:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853272.404417:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526205696 00000100:00100000:1.0:1787853272.404439:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526205696 00000100:00100000:1.0:1787853272.404542:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 48 00000100:00100000:1.0:1787853272.404555:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49079f30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+29:14560:x1874699526205696:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787853272.404634:0:14329:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853272.404664:0:14329:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900031600/0x710df789068e7819 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c5079389b7b expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853272.404804:0:14329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900030200/0x710df789068e7820 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853272.404823:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900030200/0x710df789068e7820 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853272.404839:0:14329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900030200/0x710df789068e7820 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787853272.404852:0:14329:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787853272.404996:0:14329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900030200/0x710df789068e7820 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853272.405025:0:14329:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900030200/0x710df789068e7820 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853272.405032:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900030200/0x710df789068e7820 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853272.405039:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4900030200 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:1.0:1787853272.405044:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900030200/0x710df789068e7820 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853272.405052:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900030200/0x710df789068e7820 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853272.405068:0:14329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f4914d11100) 00010000:00010000:1.0:1787853272.405070:0:14329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787853272.405076:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900030200/0x710df789068e7820 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853272.405082:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900030200/0x710df789068e7820 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853272.405136:0:14329:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900031600/0x710df789068e7819 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389b7b expref: 31 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853272.405147:0:14329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f4908cc0700) 00010000:00010000:1.0:1787853272.405150:0:14329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787853272.405154:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900031600/0x710df789068e7819 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389b7b expref: 31 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853272.405164:0:14329:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4900031600, rc 0) 00000100:00100000:1.0:1787853272.405278:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49079f30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+30:14560:x1874699526205696:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 Request processed in 725us (5408us total) trans 8589934619 rc 301/301 00000100:00100000:1.0:1787853272.405287:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 48 00000100:00100000:2.0:1787853272.420823:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853272.420950:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526205824 00000100:00100000:0.0:1787853272.420966:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526205824 00000100:00100000:0.0:1787853272.421059:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 49 00000100:00100000:0.0:1787853272.421071:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49079f1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+30:14560:x1874699526205824:12345-192.168.204.1@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787853272.421144:0:14331:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787853272.421310:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49079f1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+30:14560:x1874699526205824:12345-192.168.204.1@tcp:53:lhsmtool_posix.0 Request processed in 241us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853272.421319:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 49 00000100:00100000:3.0:1787853272.426763:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853272.427055:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526206080 00000100:00100000:1.0:1787853272.427069:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526206080 00000100:00100000:1.0:1787853272.427166:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 50 00000100:00100000:1.0:1787853272.427177:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4941af2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+30:14560:x1874699526206080:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787853272.427203:0:14329:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853272.427231:0:14329:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900031600/0x710df789068e782e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c5079389b82 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787853272.452419:0:14329:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x7:0x0], count =27 00000004:00080000:0.0:1787853272.452433:0:14329:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x7:0x0]+27 in llog 00000004:00080000:0.0:1787853272.452498:0:14329:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:0.0:1787853272.457472:0:14329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e7835 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853272.457505:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e7835 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853272.457523:0:14329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e7835 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853272.457708:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900031600/0x710df789068e782e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389b82 expref: 33 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853272.457737:0:14329:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e7835 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389b82 expref: 32 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853272.457747:0:14329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8f491176ba00) 00010000:00010000:0.0:1787853272.457749:0:14329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787853272.457754:0:14329:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49415b8c00, rc 0) 00000100:00100000:0.0:1787853272.457865:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4941af2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+32:14560:x1874699526206080:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 Request processed in 30689us (31118us total) trans 8589934620 rc 0/0 00000100:00100000:0.0:1787853272.457877:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 50 00000100:00100000:2.0:1787853272.469154:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853272.469321:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526206336 00000100:00100000:0.0:1787853272.469334:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526206336 00000100:00100000:0.0:1787853272.469433:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 51 00000100:00100000:0.0:1787853272.469447:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49079f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+32:14560:x1874699526206336:12345-192.168.204.1@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787853272.469538:0:14331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787853272.469632:0:14331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e7835 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389b82 expref: 32 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853272.469669:0:14331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8f491176ba00) 00010000:00010000:0.0:1787853272.469683:0:14331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787853272.469713:0:14331:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8000/0x710df789068e7843 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853272.469731:0:14331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8000/0x710df789068e7843 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853272.469743:0:14331:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8000/0x710df789068e7843 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853272.469758:0:14331:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9600/0x710df789068e784a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xcd02b181 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853272.469766:0:14331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9600/0x710df789068e784a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xcd02b181 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853272.469773:0:14331:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9600/0x710df789068e784a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xcd02b181 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853272.469879:0:14331:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8000/0x710df789068e7843 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853272.469908:0:14331:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8000/0x710df789068e7843 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853272.469914:0:14331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8000/0x710df789068e7843 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853272.469921:0:14331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b8000 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:0.0:1787853272.469926:0:14331:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8000/0x710df789068e7843 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853272.469949:0:14331:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8000/0x710df789068e7843 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853272.469958:0:14331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8f4914d11900) 00010000:00010000:0.0:1787853272.469961:0:14331:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787853272.469965:0:14331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8000/0x710df789068e7843 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853272.469971:0:14331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8000/0x710df789068e7843 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853272.469981:0:14331:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9600/0x710df789068e784a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xcd02b181 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853272.469996:0:14331:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9600/0x710df789068e784a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xcd02b181 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853272.470002:0:14331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9600/0x710df789068e784a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xcd02b181 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853272.470007:0:14331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b9600 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:0.0:1787853272.470017:0:14331:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9600/0x710df789068e784a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xcd02b181 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853272.470023:0:14331:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9600/0x710df789068e784a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xcd02b181 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853272.470041:0:14331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xcd02b181 (ffff8f491176bd00) 00010000:00010000:0.0:1787853272.470044:0:14331:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787853272.470047:0:14331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9600/0x710df789068e784a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xcd02b181 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853272.470052:0:14331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9600/0x710df789068e784a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xcd02b181 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853272.470166:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49079f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+31:14560:x1874699526206336:12345-192.168.204.1@tcp:36:lhsmtool_posix.0 Request processed in 722us (1027us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787853272.470176:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 51 00000100:00100000:2.0:1787853272.484818:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853272.485296:0:16560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526206464 00000100:00100000:0.0:1787853272.485308:0:16560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526206464 00000100:00100000:0.0:1787853272.485395:0:16560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 52 00000100:00100000:0.0:1787853272.485407:0:16560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49079f0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+31:14560:x1874699526206464:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787853272.485435:0:16560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853272.485464:0:16560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8e00/0x710df789068e7851 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c5079389b89 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853272.485511:0:16560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9800/0x710df789068e7858 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853272.485528:0:16560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9800/0x710df789068e7858 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853272.485567:0:16560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9800/0x710df789068e7858 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853272.485738:0:16560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8e00/0x710df789068e7851 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389b89 expref: 33 pid: 16560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853272.485763:0:16560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9800/0x710df789068e7858 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389b89 expref: 32 pid: 16560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853272.485774:0:16560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8f491176bf00) 00010000:00010000:0.0:1787853272.485777:0:16560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787853272.485782:0:16560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49415b9800, rc 0) 00000100:00100000:0.0:1787853272.485879:0:16560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49079f0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+32:14560:x1874699526206464:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 Request processed in 474us (1077us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853272.485887:0:16560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 52 00000100:00100000:1.0:1787853272.497656:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853272.497769:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526206720 00000100:00100000:0.0:1787853272.497782:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526206720 00000100:00100000:0.0:1787853272.497861:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 53 00000100:00100000:0.0:1787853272.497873:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4803e67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+32:14560:x1874699526206720:12345-192.168.204.1@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787853272.498019:0:14331:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8e00/0x710df789068e785f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853272.498051:0:14331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8e00/0x710df789068e785f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853272.498067:0:14331:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8e00/0x710df789068e785f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787853272.498705:0:14331:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:0.0:1787853272.498721:0:14331:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 592040149963ns, next at 593040145515ns, rc = 0 00000004:00010000:0.0:1787853272.498845:0:14331:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a437a6a0 reply state 00000000c9a8ad58 transno 8589934621 ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8e00/0x710df789068e785f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853272.498857:0:14331:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787853272.499034:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4803e67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+34:14560:x1874699526206720:12345-192.168.204.1@tcp:36:lhsmtool_posix.0 Request processed in 1159us (1393us total) trans 8589934621 rc 0/0 00000100:00100000:0.0:1787853272.499044:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 53 00010000:00010000:1.0:1787853272.506475:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8e00/0x710df789068e785f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853272.506499:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8e00/0x710df789068e785f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853272.506509:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8e00/0x710df789068e785f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853272.506517:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b8e00 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:1.0:1787853272.506524:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8e00/0x710df789068e785f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853272.506534:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8e00/0x710df789068e785f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853272.506558:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8f491176bf00) 00010000:00010000:1.0:1787853272.506561:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787853272.506628:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8e00/0x710df789068e785f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853272.506636:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8e00/0x710df789068e785f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853272.514343:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853272.514505:0:16560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526206848 00000100:00100000:0.0:1787853272.514522:0:16560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526206848 00000100:00100000:0.0:1787853272.514681:0:16560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 54 00000100:00100000:0.0:1787853272.514694:0:16560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4803e65e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+33:14560:x1874699526206848:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787853272.514728:0:16560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853272.514756:0:16560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9600/0x710df789068e7866 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c5079389b90 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853272.514833:0:16560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9600/0x710df789068e7866 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389b90 expref: 34 pid: 16560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853272.514851:0:16560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9600/0x710df789068e7866 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389b90 expref: 34 pid: 16560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853272.514873:0:16560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8f491176bf00) 00010000:00010000:0.0:1787853272.514877:0:16560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787853272.514882:0:16560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49415b9600, rc 0) 00000100:00100000:0.0:1787853272.515009:0:16560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4803e65e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+34:14560:x1874699526206848:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 Request processed in 317us (691us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853272.515017:0:16560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 54 00000100:00100000:3.0:1787853272.531147:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853272.531279:0:15498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526206976 00000100:00100000:1.0:1787853272.531291:0:15498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526206976 00000100:00100000:1.0:1787853272.531398:0:15498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 12 00000100:00100000:1.0:1787853272.531411:0:15498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4934117840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+5:2362:x1874699526206976:12345-192.168.204.1@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1787853272.532135:0:15498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4934117840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+6:2362:x1874699526206976:12345-192.168.204.1@tcp:2:lhsmtool_posix.0 Request processed in 716us (994us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1787853272.532161:0:15498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 12 00000100:00080000:0.0:1787853272.532350:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787853272.550744:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853272.551088:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526207232 00000100:00100000:1.0:1787853272.551102:0:14332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526207232 00000100:00100000:1.0:1787853272.551190:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 11 00000100:00100000:1.0:1787853272.551203:0:14332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49092bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+34:14560:x1874699526207232:12345-192.168.204.1@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787853272.552475:0:14332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49092bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+35:14560:x1874699526207232:12345-192.168.204.1@tcp:35:lhsmtool_posix.0 Request processed in 1260us (1732us total) trans 8589934622 rc 0/0 00000100:00100000:1.0:1787853272.552489:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 11 00000100:00100000:3.0:1787853272.578050:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853272.586061:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526207488 00000100:00100000:0.0:1787853272.586083:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526207488 00000100:00100000:0.0:1787853272.586184:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 55 00000100:00100000:0.0:1787853272.586197:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49092be1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+35:14560:x1874699526207488:12345-192.168.204.1@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787853272.586375:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49092be1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+35:14560:x1874699526207488:12345-192.168.204.1@tcp:57:lhsmtool_posix.0 Request processed in 180us (8343us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853272.586383:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 55 00000100:00100000:3.0:1787853272.590647:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853272.590895:0:16560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526207616 00000100:00100000:0.0:1787853272.590911:0:16560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526207616 00000100:00100000:0.0:1787853272.591021:0:16560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 56 00000100:00100000:0.0:1787853272.591034:0:16560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49092bcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+35:14560:x1874699526207616:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787853272.591063:0:16560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853272.591092:0:16560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8000/0x710df789068e786d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c5079389b97 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853272.591196:0:16560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e7874 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853272.591215:0:16560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e7874 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853272.591230:0:16560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e7874 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787853272.591277:0:16560:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787853272.591320:0:16560:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e7874 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853272.591366:0:16560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8000/0x710df789068e786d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389b97 expref: 37 pid: 16560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853272.591391:0:16560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e7874 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389b97 expref: 36 pid: 16560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853272.591400:0:16560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8f491176bf00) 00010000:00010000:0.0:1787853272.591403:0:16560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787853272.591407:0:16560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49415b8c00, rc 0) 00000100:00100000:0.0:1787853272.591492:0:16560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49092bcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+36:14560:x1874699526207616:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 Request processed in 461us (864us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853272.591500:0:16560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 56 00000100:00100000:2.0:1787853272.613477:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853272.613629:0:15015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526207744 00000100:00100000:0.0:1787853272.613643:0:15015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526207744 00000100:00100000:0.0:1787853272.613727:0:15015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 13 00000100:00100000:0.0:1787853272.613740:0:15015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49079f1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+6:2363:x1874699526207744:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787853272.613770:0:15015:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853272.613801:0:15015:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000854d8157/0x710df789068e787b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c5079389b9e expref: -99 pid: 15015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787853272.613842:0:15015:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9079d8, blocks: 0x1 00010000:00010000:0.0:1787853272.613871:0:15015:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=592s v=(0 0) 00010000:00010000:0.0:1787853272.613877:0:15015:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787853272.613889:0:15015:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000854d8157/0x710df789068e787b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389b9e expref: 7 pid: 15015 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853272.613947:0:15015:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000854d8157/0x710df789068e787b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389b9e expref: 7 pid: 15015 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853272.613969:0:15015:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49415b8000, rc 0) 00000100:00100000:0.0:1787853272.614759:0:15015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49079f1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+7:2363:x1874699526207744:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 Request processed in 1016us (1295us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853272.614770:0:15015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 13 00000100:00100000:3.0:1787853272.633894:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853272.634153:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526208000 00000100:00100000:0.0:1787853272.634166:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526208000 00000100:00100000:0.0:1787853272.634242:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 57 00000100:00100000:0.0:1787853272.634254:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493bee8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+36:14560:x1874699526208000:12345-192.168.204.1@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787853272.634472:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493bee8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+36:14560:x1874699526208000:12345-192.168.204.1@tcp:57:lhsmtool_posix.0 Request processed in 220us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853272.634481:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 57 00000100:00100000:3.0:1787853272.639963:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853272.642503:0:16560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526208128 00000100:00100000:0.0:1787853272.642522:0:16560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526208128 00000100:00100000:0.0:1787853272.642738:0:16560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 58 00000100:00100000:0.0:1787853272.642752:0:16560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493beea940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+36:14560:x1874699526208128:12345-192.168.204.1@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1787853272.813262:0:16560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493beea940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+36:14560:x1874699526208128:12345-192.168.204.1@tcp:44:lhsmtool_posix.0 Request processed in 170492us (173292us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853272.813282:0:16560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 58 00000001:00080000:2.0:1787853272.813412:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934621 is committed 00000004:00080000:2.0:1787853272.813423:0:5858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:2.0:1787853272.813476:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000100:00100000:0.0:1787853272.814132:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787853272.814160:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f492eb9a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874699552409088:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1787853272.814266:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853272.814758:0:15498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552409088 00000100:00100000:1.0:1787853272.816615:0:15498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552409088 00000100:00100000:1.0:1787853272.817704:0:15498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00080000:0.0:1787853272.817897:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787853272.818120:0:15498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f492eb9b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1874699552409088:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1787853272.820223:0:15498:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1787853272.820236:0:15498:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1787853272.820259:0:15498:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787853272.820262:0:15498:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1787853272 -> 1787853272 00002000:00010000:1.0:1787853272.820266:0:15498:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1787853272.820410:0:15498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f492eb9b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3308:x1874699552409088:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2300us (6137us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1787853272.820424:0:15498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:3.0:1787853272.821009:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787853272.822195:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8f492eb9a940/2, rc 0, transno 8589934595 00000100:00100000:2.0:1787853272.822214:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f492eb9a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874699552409088:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787853272.822442:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853272.823430:0:15013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526208256 00000100:00100000:2.0:1787853272.823448:0:15013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526208256 00000100:00100000:2.0:1787853272.823612:0:15013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 15 00000100:00100000:2.0:1787853272.823647:0:15013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49056da580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+7:2362:x1874699526208256:12345-192.168.204.1@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1787853272.823878:0:15013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49056da580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+7:2362:x1874699526208256:12345-192.168.204.1@tcp:16:lhsmtool_posix.0 Request processed in 234us (1440us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853272.823888:0:15013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 15 00000100:00100000:1.0:1787853272.828039:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853272.828165:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526208512 00000100:00100000:3.0:1787853272.828178:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526208512 00000100:00100000:3.0:1787853272.828299:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 59 00000100:00100000:3.0:1787853272.828312:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49056db0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+13:14560:x1874699526208512:12345-192.168.204.1@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787853272.828392:0:14330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787853272.828445:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8c00/0x710df789068e7874 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389b97 expref: 13 pid: 16560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853272.828471:0:14330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8f491176bf00) 00010000:00010000:3.0:1787853272.828478:0:14330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787853272.828520:0:14330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20200/0x710df789068e7882 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853272.828536:0:14330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20200/0x710df789068e7882 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853272.828548:0:14330:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20200/0x710df789068e7882 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787853272.828928:0:14330:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005cbb3dc0 reply state 000000002af90109 transno 8589934623 ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20200/0x710df789068e7882 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853272.828940:0:14330:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787853272.829100:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49056db0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+14:14560:x1874699526208512:12345-192.168.204.1@tcp:36:lhsmtool_posix.0 Request processed in 790us (1076us total) trans 8589934623 rc 0/0 00000100:00100000:3.0:1787853272.829109:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 59 00000100:00100000:2.0:1787853272.841297:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853272.842060:0:15016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526208640 00000100:00100000:3.0:1787853272.842077:0:15016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526208640 00000100:00100000:3.0:1787853272.842158:0:15016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 16 00000100:00100000:3.0:1787853272.842169:0:15016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49079f21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+7:14560:x1874699526208640:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787853272.842193:0:15016:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853272.842220:0:15016:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d8fa5a29/0x710df789068e7889 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c5079389ba5 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853272.842267:0:15016:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000854d8157/0x710df789068e787b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389b9e expref: 8 pid: 15015 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853272.842295:0:15016:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787853272.842300:0:15016:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787853272.842306:0:15016:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8fa5a29/0x710df789068e7889 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389ba5 expref: 8 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853272.842350:0:15016:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000854d8157/0x710df789068e787b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389b9e expref: 8 pid: 15015 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853272.842367:0:15016:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000854d8157/0x710df789068e787b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389b9e expref: 8 pid: 15015 timeout: 692 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853272.842384:0:15016:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f493beead00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:15016:1874699552409216:192.168.204.1@tcp:104: 00010000:00010000:0.0:1787853272.846552:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20200/0x710df789068e7882 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853272.846590:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20200/0x710df789068e7882 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853272.846600:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20200/0x710df789068e7882 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853272.846606:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4921e20200 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:0.0:1787853272.846612:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20200/0x710df789068e7882 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853272.846622:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20200/0x710df789068e7882 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853272.846648:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8f491176bf00) 00010000:00010000:0.0:1787853272.846651:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787853272.846665:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20200/0x710df789068e7882 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853272.846672:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20200/0x710df789068e7882 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853272.849389:0:15016:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f492064e0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787853272.850243:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853272.852078:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526208768 00000100:00100000:3.0:1787853272.852104:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526208768 00010000:00010000:3.0:1787853272.852180:0:14316:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000854d8157/0x710df789068e787b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389b9e expref: 9 pid: 15015 timeout: 692 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853272.852245:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 14 00000100:00100000:3.0:1787853272.852258:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49079f2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+9:2362:x1874699526208768:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787853272.852280:0:14316:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787853272.852313:0:14316:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000854d8157/0x710df789068e787b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389b9e expref: 9 pid: 15015 timeout: 692 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853272.852357:0:14316:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000854d8157/0x710df789068e787b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389b9e expref: 9 pid: 15015 timeout: 692 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853272.852395:0:14316:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787853272.852400:0:14316:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787853272.852408:0:14316:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d8fa5a29/0x710df789068e7889 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389ba5 expref: 9 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853272.852422:0:14316:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8fa5a29/0x710df789068e7889 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389ba5 expref: 9 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853272.852479:0:14316:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000d8fa5a29/0x710df789068e7889 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389ba5 expref: 9 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853272.852498:0:14316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f493beeb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:14316:1874699552409344:192.168.204.1@tcp:105: 00010000:00010000:1.0:1787853272.853172:0:15016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000854d8157/0x710df789068e787b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389b9e expref: 9 pid: 15015 timeout: 692 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853272.853194:0:15016:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f493beead00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:15016:1874699552409216:192.168.204.1@tcp:104: 00010000:00010000:1.0:1787853272.853228:0:15016:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d8fa5a29/0x710df789068e7889 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389ba5 expref: 8 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853272.853239:0:15016:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4921e21600, rc 0) 00000100:00100000:1.0:1787853272.853277:0:15016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49079f21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+8:14560:x1874699526208640:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 Request processed in 11110us (11995us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853272.853287:0:15016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 16 00000100:00100000:3.0:1787853272.853343:0:14316:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f492064e780 going to sleep for 11 seconds 00000100:00100000:2.0:1787853272.860988:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853272.861080:0:15015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526208896 00000100:00100000:0.0:1787853272.861090:0:15015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526208896 00000100:00100000:3.0:1787853272.861095:0:14316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f493beeb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:14316:1874699552409344:192.168.204.1@tcp:105: 00010000:00010000:3.0:1787853272.861127:0:14316:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787853272.861159:0:15015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 17 00000100:00100000:0.0:1787853272.861170:0:15015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4920570780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+8:2363:x1874699526208896:12345-192.168.204.1@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1787853272.861203:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49079f2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+8:2362:x1874699526208768:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 8949us (10969us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853272.861214:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 14 00002000:00010000:0.0:1787853272.861464:0:15015:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1787853272.861485:0:15015:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1787853272 00002000:00010000:0.0:1787853272.861487:0:15015:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1787853270 00002000:00010000:0.0:1787853272.861490:0:15015:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1787853272 -> 1787853272 00002000:00010000:0.0:1787853272.861492:0:15015:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1787853272.861536:0:15015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4920570780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+8:2363:x1874699526208896:12345-192.168.204.1@tcp:2:lhsmtool_posix.0 Request processed in 368us (575us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1787853272.861544:0:15015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 17 00000100:00100000:2.0:1787853272.874147:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853272.874366:0:15498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526209024 00000100:00100000:1.0:1787853272.874378:0:15498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526209024 00000100:00100000:1.0:1787853272.874454:0:15498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 18 00000100:00100000:1.0:1787853272.874466:0:15498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f492eb8b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+8:2362:x1874699526209024:12345-192.168.204.1@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787853272.874526:0:15498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000039eacbdd/0x710df789068e7890 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853272.874626:0:15498:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d8fa5a29/0x710df789068e7889 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389ba5 expref: 8 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853272.874637:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787853272.874642:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787853272.874647:0:15498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000039eacbdd/0x710df789068e7890 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853272.874695:0:15498:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d8fa5a29/0x710df789068e7889 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389ba5 expref: 8 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853272.874901:0:15498:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d8fa5a29/0x710df789068e7889 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389ba5 expref: 8 pid: 15016 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853272.874922:0:15498:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f49056d8b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15498:1874699552409472:192.168.204.1@tcp:104: 00000100:00100000:1.0:1787853272.875051:0:15498:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f4904fda300 going to sleep for 11 seconds 00000100:00100000:1.0:1787853272.878957:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853272.879345:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526209152 00000100:00100000:3.0:1787853272.879358:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526209152 00010000:00010000:3.0:1787853272.879418:0:14315:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d8fa5a29/0x710df789068e7889 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389ba5 expref: 9 pid: 15016 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853272.879489:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 15 00000100:00100000:3.0:1787853272.879500:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49056dad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+9:2362:x1874699526209152:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787853272.879522:0:14315:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787853272.879553:0:14315:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d8fa5a29/0x710df789068e7889 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389ba5 expref: 9 pid: 15016 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853272.879621:0:14315:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d8fa5a29/0x710df789068e7889 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389ba5 expref: 9 pid: 15016 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853272.879668:0:14315:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787853272.879674:0:14315:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787853272.879681:0:14315:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000039eacbdd/0x710df789068e7890 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853272.879692:0:14315:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000039eacbdd/0x710df789068e7890 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853272.879727:0:14315:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787853272.880053:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49056dad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+9:2362:x1874699526209152:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 553us (1110us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853272.880063:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 15 00010000:00010000:2.0:1787853272.885101:0:15498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d8fa5a29/0x710df789068e7889 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389ba5 expref: 8 pid: 15016 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853272.885139:0:15498:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f49056d8b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15498:1874699552409472:192.168.204.1@tcp:104: 00010000:00010000:2.0:1787853272.885174:0:15498:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000039eacbdd/0x710df789068e7890 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853272.885189:0:15498:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000039eacbdd/0x710df789068e7890 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853272.885196:0:15498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000039eacbdd/0x710df789068e7890 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853272.885244:0:15498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000039eacbdd/0x710df789068e7890 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853272.885252:0:15498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000039eacbdd/0x710df789068e7890 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853272.885283:0:15498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000039eacbdd/0x710df789068e7890 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853272.885291:0:15498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4900031800 already unused, calling callback (ffffffffc1528440) 00010000:00010000:2.0:1787853272.885295:0:15498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000039eacbdd/0x710df789068e7890 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853272.885304:0:15498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000039eacbdd/0x710df789068e7890 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853272.885327:0:15498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000039eacbdd/0x710df789068e7890 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853272.885336:0:15498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000039eacbdd/0x710df789068e7890 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853272.885458:0:15498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f492eb8b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+7:2362:x1874699526209024:12345-192.168.204.1@tcp:1:lhsmtool_posix.0 Request processed in 10993us (11323us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853272.885469:0:15498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 18 00000100:00100000:1.0:1787853272.893172:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853272.893293:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526209408 00000100:00100000:2.0:1787853272.893308:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526209408 00000100:00100000:2.0:1787853272.893399:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 60 00000100:00100000:2.0:1787853272.893412:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49056db840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+13:14560:x1874699526209408:12345-192.168.204.1@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787853272.893531:0:14329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906502200/0x710df789068e7897 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853272.893611:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906502200/0x710df789068e7897 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853272.893626:0:14329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906502200/0x710df789068e7897 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853272.894013:0:14329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906502e00/0x710df789068e789e lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853272.894027:0:14329:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9600/0x710df789068e7866 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389b90 expref: 14 pid: 16560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853272.894037:0:14329:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906502e00/0x710df789068e789e lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853272.894081:0:14329:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9600/0x710df789068e7866 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389b90 expref: 14 pid: 16560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853272.894099:0:14329:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9600/0x710df789068e7866 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389b90 expref: 14 pid: 16560 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853272.894118:0:14329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f492eb892c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14329:1874699552409600:192.168.204.1@tcp:104: 00000100:00100000:2.0:1787853272.894234:0:14329:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f4904c00d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787853272.897750:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853272.897805:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853272.897856:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853272.897896:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853272.897932:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853272.898000:0:15016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526209664 00000100:00100000:2.0:1787853272.898013:0:15016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526209664 00000100:00100000:2.0:1787853272.898081:0:15016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526209920 00000100:00100000:2.0:1787853272.898084:0:15016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526209920 00000100:00100000:2.0:1787853272.898102:0:15016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526210048 00000100:00100000:2.0:1787853272.898104:0:15016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526210048 00000100:00100000:2.0:1787853272.898122:0:15016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 14 00000100:00100000:2.0:1787853272.898134:0:15016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f492eb8a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+5:2363:x1874699526209664:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:2.0:1787853272.898235:0:15016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f492eb8a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+5:2363:x1874699526209664:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 102us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853272.898243:0:15016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 14 00000100:00100000:2.0:1787853272.898262:0:15016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 15 00000100:00100000:2.0:1787853272.898268:0:15016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4904cd4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:23cfdd4f-7ffb-4b42-8d8e-04a589e53647+5:2363:x1874699526209920:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:2.0:1787853272.898295:0:15016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4904cd4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:23cfdd4f-7ffb-4b42-8d8e-04a589e53647+5:2363:x1874699526209920:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 27us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853272.898302:0:15016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 15 00000100:00100000:2.0:1787853272.898314:0:15016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 16 00000100:00100000:2.0:1787853272.898320:0:15016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4904cd6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:23cfdd4f-7ffb-4b42-8d8e-04a589e53647+5:2363:x1874699526210048:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:2.0:1787853272.898343:0:15016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4904cd6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:23cfdd4f-7ffb-4b42-8d8e-04a589e53647+5:2363:x1874699526210048:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 23us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853272.898349:0:15016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 16 00000100:00080000:2.0:1787853272.898366:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787853272.898371:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787853272.898537:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526209792 00000100:00100000:2.0:1787853272.898542:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526209792 00000100:00080000:2.0:1787853272.898561:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787853272.898621:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 28 00000100:00100000:2.0:1787853272.898637:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4904cd6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23cfdd4f-7ffb-4b42-8d8e-04a589e53647+6:2363:x1874699526209792:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:2.0:1787853272.898683:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4904cd6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23cfdd4f-7ffb-4b42-8d8e-04a589e53647+6:2363:x1874699526209792:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 47us (786us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853272.898690:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 28 00000100:00100000:1.0:1787853272.899956:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526209536 00000100:00100000:1.0:1787853272.899973:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526209536 00000100:00100000:1.0:1787853272.900056:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 124 00000100:00100000:1.0:1787853272.900066:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493d129450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f34adbd4-9a89-4f2c-8086-7f2012dc74db+13:2363:x1874699526209536:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:1.0:1787853272.900159:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493d129450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f34adbd4-9a89-4f2c-8086-7f2012dc74db+13:2363:x1874699526209536:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 95us (2302us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853272.900185:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 124 00000100:00100000:2.0:1787853272.903397:0:14329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f492eb892c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14329:1874699552409600:192.168.204.1@tcp:104: 00010000:00010000:2.0:1787853272.903443:0:14329:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906502e00/0x710df789068e789e lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853272.917180:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853272.926230:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526210176 00000100:00100000:3.0:1787853272.926251:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526210176 00010000:00010000:3.0:1787853272.926324:0:14316:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9600/0x710df789068e7866 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389b90 expref: 15 pid: 16560 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853272.926490:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 16 00000100:00100000:0.0:1787853272.926506:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4904cd5e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+15:2362:x1874699526210176:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787853272.926527:0:14316:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787853272.926535:0:14316:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9600/0x710df789068e7866 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389b90 expref: 15 pid: 16560 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853272.926551:0:14316:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9600/0x710df789068e7866 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389b90 expref: 15 pid: 16560 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853272.926622:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9600/0x710df789068e7866 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389b90 expref: 15 pid: 16560 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853272.926644:0:14316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8f491176bf00) 00010000:00010000:0.0:1787853272.926651:0:14316:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906502e00/0x710df789068e789e lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853272.926663:0:14316:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906502e00/0x710df789068e789e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853272.926673:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906502e00/0x710df789068e789e lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853272.926714:0:14316:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787853272.926804:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4904cd5e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+14:2362:x1874699526210176:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 302us (9643us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853272.926814:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 16 00010000:00010000:2.0:1787853272.927147:0:14329:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906502e00/0x710df789068e789e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853272.927156:0:14329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906502e00/0x710df789068e789e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787853272.927408:0:14329:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:2.0:1787853272.927628:0:14329:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000001:00080000:2.0:1787853272.927686:0:14329:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934626 00000100:00100000:2.0:1787853272.927803:0:14329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f4904cd7480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14329:1874699552409728:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787853272.929725:0:14329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853272.929831:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552409728 00000100:00100000:2.0:1787853272.929840:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552409728 00000100:00100000:2.0:1787853272.929970:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787853272.929995:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4904cd61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14329:x1874699552409728:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787853272.930098:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4904cd61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14329:x1874699552409728:12345-0@lo:1000:mdt00_000.0 Request processed in 107us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853272.930105:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787853272.930491:0:14329:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f49065f7600 going to sleep for 11 seconds 00000100:00100000:3.0:1787853272.930555:0:14329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f4904cd7480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14329:1874699552409728:0@lo:1000:mdt00_000.0 00000001:00080000:3.0:1787853272.931415:0:14329:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934627 00000100:00100000:3.0:1787853272.931522:0:14329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f493beeb480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14329:1874699552409856:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1787853272.931619:0:14329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853272.931645:0:14329:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f492064e180 going to sleep for 11 seconds 00000100:00100000:2.0:1787853272.931692:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552409856 00000100:00100000:2.0:1787853272.931721:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552409856 00000100:00100000:2.0:1787853272.931766:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787853272.931775:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493bee8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14329:x1874699552409856:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787853272.932735:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493bee8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14329:x1874699552409856:12345-0@lo:1000:mdt00_000.0 Request processed in 791us (946us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1787853272.932747:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787853272.932921:0:14329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f493beeb480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14329:1874699552409856:0@lo:1000:mdt00_000.0 00010000:00010000:3.0:1787853272.932990:0:14329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906502e00/0x710df789068e789e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853272.933003:0:14329:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906502e00/0x710df789068e789e lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853272.933011:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906502e00/0x710df789068e789e lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853272.933018:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4906502e00 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:3.0:1787853272.933024:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906502e00/0x710df789068e789e lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853272.933033:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906502e00/0x710df789068e789e lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853272.933053:0:14329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8f491176bf00) 00010000:00010000:3.0:1787853272.933057:0:14329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787853272.933063:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906502e00/0x710df789068e789e lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853272.933087:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906502e00/0x710df789068e789e lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853272.933131:0:14329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900030e00/0x710df789068e77f6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 16560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853272.933139:0:14329:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900030e00/0x710df789068e77f6 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 16560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853272.933145:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900030e00/0x710df789068e77f6 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 16560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853272.933150:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4900030e00 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:3.0:1787853272.933153:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900030e00/0x710df789068e77f6 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 16560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853272.933159:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900030e00/0x710df789068e77f6 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 16560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853272.933168:0:14329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f4914d11100) 00010000:00010000:3.0:1787853272.933171:0:14329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787853272.933182:0:14329:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503c00/0x710df789068e77fd lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389b74 expref: 17 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853272.933196:0:14329:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503c00/0x710df789068e77fd lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389b74 expref: 17 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853272.933207:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503c00/0x710df789068e77fd lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389b74 expref: 17 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853272.933290:0:14329:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906503c00/0x710df789068e77fd lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389b74 expref: 17 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853272.933306:0:14329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f493bee92c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14329:1874699552409984:192.168.204.1@tcp:105: 00000100:00100000:3.0:1787853272.933409:0:14329:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f492064ed80 going to sleep for 11 seconds 00000100:00100000:2.0:1787853272.946947:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853272.947080:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526210304 00000100:00100000:0.0:1787853272.947094:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526210304 00000100:00100000:0.0:1787853272.947179:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 12 00000100:00100000:0.0:1787853272.947192:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4904cd7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+18:14558:x1874699526210304:12345-192.168.204.1@tcp:49:bash.0 00000100:00100000:0.0:1787853272.947401:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4904cd7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+18:14558:x1874699526210304:12345-192.168.204.1@tcp:49:bash.0 Request processed in 211us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853272.947410:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 12 00000100:00100000:3.0:1787853272.947525:0:14329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f493bee92c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14329:1874699552409984:192.168.204.1@tcp:105: 00010000:00010000:3.0:1787853272.947564:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900030e00/0x710df789068e77f6 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 16560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853272.947621:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4900030e00/0x710df789068e77f6 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 16560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853272.947666:0:14329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21200/0x710df789068e78a5 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853272.947684:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21200/0x710df789068e78a5 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853272.947699:0:14329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21200/0x710df789068e78a5 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853272.947711:0:14329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21200/0x710df789068e78a5 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853272.947719:0:14329:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21200/0x710df789068e78a5 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853272.947726:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21200/0x710df789068e78a5 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853272.947756:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4921e21200 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:3.0:1787853272.947761:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21200/0x710df789068e78a5 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853272.947770:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21200/0x710df789068e78a5 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853272.947784:0:14329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f4914d11100) 00010000:00010000:3.0:1787853272.947787:0:14329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787853272.947792:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21200/0x710df789068e78a5 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853272.947797:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21200/0x710df789068e78a5 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853272.947813:0:14329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906502200/0x710df789068e7897 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853272.947819:0:14329:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906502200/0x710df789068e7897 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853272.947825:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906502200/0x710df789068e7897 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853272.947830:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4906502200 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:3.0:1787853272.947833:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906502200/0x710df789068e7897 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853272.947839:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906502200/0x710df789068e7897 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853272.947860:0:14329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f4914d11100) 00010000:00010000:3.0:1787853272.947863:0:14329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787853272.947866:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906502200/0x710df789068e7897 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853272.947871:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4906502200/0x710df789068e7897 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853272.948147:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49056db840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+17:14560:x1874699526209408:12345-192.168.204.1@tcp:57:lhsmtool_posix.0 Request processed in 54736us (54988us total) trans 8589934628 rc 0/0 00000100:00100000:3.0:1787853272.948158:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 60 00000020:00080000:3.0:1787853272.948163:0:14329:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1787853272.948362:0:14361:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787853272.948368:0:14361:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787853272.948401:0:14361:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1787853272.948408:0:14361:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1787853272.954677:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1787853272.954736:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853272.954983:0:15016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526210432 00000100:00100000:2.0:1787853272.954996:0:15016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526210432 00000100:00100000:2.0:1787853272.955220:0:15016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 19 00000100:00100000:2.0:1787853272.955238:0:15016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49056dbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+7:14558:x1874699526210432:12345-192.168.204.1@tcp:101:bash.0 00010000:00010000:2.0:1787853272.955266:0:15016:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853272.955295:0:15016:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088fd83a2/0x710df789068e78ac lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c5079389bac expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787853272.955331:0:15016:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a9079d8, atime: 0x6a9079d6, ctime: 0x6a9079d8, blocks: 0x1 00010000:00010000:2.0:1787853272.955361:0:15016:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=592s v=(0 0) 00010000:00010000:2.0:1787853272.955367:0:15016:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787853272.955379:0:15016:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088fd83a2/0x710df789068e78ac lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389bac expref: 8 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853272.955399:0:15016:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000088fd83a2/0x710df789068e78ac lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389bac expref: 8 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853272.955416:0:15016:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4906502200, rc 0) 00000100:00100000:2.0:1787853272.955501:0:15016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49056dbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+8:14558:x1874699526210432:12345-192.168.204.1@tcp:101:bash.0 Request processed in 267us (840us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853272.955530:0:15016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 19 00000100:00100000:0.0:1787853272.955634:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526210688 00000100:00100000:0.0:1787853272.955640:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526210688 00000100:00100000:0.0:1787853272.955689:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 13 00000100:00100000:0.0:1787853272.955697:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49056da1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+17:14560:x1874699526210688:12345-192.168.204.1@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1787853272.956910:0:14333:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1787853272.957065:0:14333:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934629 00010000:00010000:0.0:1787853272.958269:0:14333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9600/0x710df789068e78b3 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853272.958297:0:14333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9600/0x710df789068e78b3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853272.958334:0:14333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9600/0x710df789068e78b3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853272.958887:0:14333:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9600/0x710df789068e78b3 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853272.958894:0:14333:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9600/0x710df789068e78b3 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853272.958901:0:14333:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9600/0x710df789068e78b3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853272.959148:0:14333:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787853272.959299:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49056da1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+19:14560:x1874699526210688:12345-192.168.204.1@tcp:35:lhsmtool_posix.0 Request processed in 3597us (4556us total) trans 8589934630 rc 0/0 00000100:00100000:0.0:1787853272.959312:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 13 00000020:00080000:0.0:1787853272.959319:0:14333:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787853272.961441:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853272.961739:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526210944 00000100:00100000:0.0:1787853272.961754:0:14332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526210944 00000100:00100000:0.0:1787853272.961840:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 14 00000100:00100000:0.0:1787853272.961853:0:14332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493bee92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+19:14558:x1874699526210944:12345-192.168.204.1@tcp:35:bash.0 00000001:00080000:0.0:1787853272.962236:0:14332:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934631 00000001:00080000:0.0:1787853272.962353:0:14332:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934632 00000100:00100000:0.0:1787853272.962480:0:14332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493bee92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+22:14558:x1874699526210944:12345-192.168.204.1@tcp:35:bash.0 Request processed in 628us (1050us total) trans 8589934633 rc 0/0 00000100:00100000:0.0:1787853272.962490:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 14 00000020:00080000:0.0:1787853272.962496:0:14332:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:1.0:1787853272.968557:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787853272.968591:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9600/0x710df789068e78b3 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853272.969056:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f49415b9600 already unused, calling callback (ffffffffc1528440) 00010000:00010000:1.0:1787853272.969062:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9600/0x710df789068e78b3 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853272.969075:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9600/0x710df789068e78b3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853272.969100:0:14318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8f491176bf00) 00010000:00010000:1.0:1787853272.969104:0:14318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787853272.969112:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9600/0x710df789068e78b3 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853272.969119:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b9600/0x710df789068e78b3 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853272.969157:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853272.969159:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853272.969161:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787853273.096300:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1787853273.096436:0:16560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526211200 00000100:00100000:0.0:1787853273.096465:0:16560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526211200 00000100:00100000:0.0:1787853273.096631:0:16560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 61 00000100:00100000:0.0:1787853273.096643:0:16560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493beebc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+22:14570:x1874699526211200:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:0.0:1787853273.096680:0:16560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853273.096708:0:16560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8800/0x710df789068e78ba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0a9c5079389bb3 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787853273.097284:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:1.0:1787853273.097675:0:16560:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 7680 00010000:00010000:1.0:1787853273.097995:0:16560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8800/0x710df789068e78ba lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389bb3 expref: 24 pid: 16560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853273.098016:0:16560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f4908cc0100) 00010000:00010000:1.0:1787853273.098027:0:16560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787853273.098035:0:16560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f49415b8800/0x710df789068e78ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.1@tcp remote: 0xd0a9c5079389bb3 expref: 24 pid: 16560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853273.098053:0:16560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f49415b8800, rc 0) 00000100:00100000:1.0:1787853273.098158:0:16560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493beebc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+23:14570:x1874699526211200:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 1515us (1871us total) trans 8589934634 rc 301/301 00000100:00100000:1.0:1787853273.098169:0:16560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 61 00000100:00100000:2.0:1787853273.101205:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853273.101322:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526211328 00000100:00100000:3.0:1787853273.101335:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526211328 00000100:00100000:3.0:1787853273.101445:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 62 00000100:00100000:3.0:1787853273.101457:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4904cd4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+23:14570:x1874699526211328:12345-192.168.204.1@tcp:34:lfs.0 00010000:00010000:3.0:1787853273.101631:0:14330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21200/0x710df789068e78c8 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853273.101653:0:14330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21200/0x710df789068e78c8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853273.101854:0:14330:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21200/0x710df789068e78c8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853273.101876:0:14330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e78cf lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853273.102113:0:14330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e78cf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853273.102125:0:14330:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e78cf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853273.102494:0:14330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21000/0x710df789068e78d6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853273.102506:0:14330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21000/0x710df789068e78d6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853273.102513:0:14330:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21000/0x710df789068e78d6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787853273.102665:0:14330:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21000/0x710df789068e78d6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853273.102682:0:14330:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21200/0x710df789068e78c8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853273.102690:0:14330:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21200/0x710df789068e78c8 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853273.102697:0:14330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21200/0x710df789068e78c8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853273.102705:0:14330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4921e21200 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:3.0:1787853273.102711:0:14330:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21200/0x710df789068e78c8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853273.102721:0:14330:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21200/0x710df789068e78c8 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853273.102745:0:14330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8f4914d11900) 00010000:00010000:3.0:1787853273.102748:0:14330:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787853273.102755:0:14330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21200/0x710df789068e78c8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853273.102762:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21200/0x710df789068e78c8 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853273.102780:0:14330:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e78cf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853273.102787:0:14330:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e78cf lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853273.102793:0:14330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e78cf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853273.102799:0:14330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4921e20c00 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:3.0:1787853273.102802:0:14330:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e78cf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853273.102809:0:14330:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e78cf lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853273.102817:0:14330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8f4910f92600) 00010000:00010000:3.0:1787853273.102819:0:14330:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787853273.102822:0:14330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e78cf lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853273.102829:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e20c00/0x710df789068e78cf lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853273.102856:0:14330:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21000/0x710df789068e78d6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853273.102863:0:14330:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21000/0x710df789068e78d6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853273.102869:0:14330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21000/0x710df789068e78d6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853273.102874:0:14330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4921e21000 already unused, calling callback (ffffffffc1f784f0) 00010000:00010000:3.0:1787853273.102877:0:14330:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21000/0x710df789068e78d6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853273.102883:0:14330:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21000/0x710df789068e78d6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853273.102890:0:14330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f4914d11100) 00010000:00010000:3.0:1787853273.102893:0:14330:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787853273.102896:0:14330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21000/0x710df789068e78d6 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853273.102902:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4921e21000/0x710df789068e78d6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853273.103190:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4904cd4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+23:14570:x1874699526211328:12345-192.168.204.1@tcp:34:lfs.0 Request processed in 1729us (1993us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853273.103204:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 62 00000100:00100000:0.0:1787853273.108047:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1787853273.108235:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526211584 00000100:00100000:2.0:1787853273.108248:0:14332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526211584 00000100:00100000:2.0:1787853273.108323:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 15 00000100:00100000:2.0:1787853273.108335:0:14332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f492eb9a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+23:14570:x1874699526211584:12345-192.168.204.1@tcp:35:lfs.0 00000100:00100000:2.0:1787853273.109013:0:14332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f492eb9a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+24:14570:x1874699526211584:12345-192.168.204.1@tcp:35:lfs.0 Request processed in 674us (976us total) trans 8589934635 rc 0/0 00000100:00100000:2.0:1787853273.109024:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 15 00000100:00100000:1.0:1787853273.326034:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f493beea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552410112:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787853273.326136:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853273.326319:0:15017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552410112 00000100:00100000:2.0:1787853273.326329:0:15017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552410112 00000100:00100000:2.0:1787853273.326394:0:15017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787853273.326405:0:15017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f49056d8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1874699552410112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787853273.326453:0:15017:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787853273.326519:0:15017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f49056d8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1874699552410112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853273.326527:0:15017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787853273.327120:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f493beea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874699552410112:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787853273.834144:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f493c58f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874699552410368:0@lo:400:kworker.0 00000100:00100000:1.0:1787853273.834254:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853273.834322:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f493c58c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1874699552410880:0@lo:400:kworker.0 00000100:00100000:1.0:1787853273.834350:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853273.834376:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787853273.834382:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f493c58c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874699552410496:0@lo:400:kworker.0 00000100:00100000:1.0:1787853273.834403:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853273.834446:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f493c58e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a76e730b-0783-4789-a5e2-a4230bb4bd66:3307:1874699552410240:0@lo:400:kworker.0 00000100:00100000:1.0:1787853273.834483:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853273.834504:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f493c58d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1874699552410752:0@lo:400:kworker.0 00000100:00100000:1.0:1787853273.834527:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853273.834547:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787853273.834552:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f493c58fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874699552410624:0@lo:400:kworker.0 00000100:00100000:1.0:1787853273.834617:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853273.834660:0:16560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552410880 00000100:00100000:2.0:1787853273.836881:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552410752 00000100:00100000:2.0:1787853273.836903:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552410752 00000100:00100000:2.0:1787853273.837014:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552410624 00000100:00100000:2.0:1787853273.837018:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552410624 00000100:00100000:2.0:1787853273.837044:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787853273.837056:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493c58d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874699552410752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853273.837203:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493c58d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874699552410752:12345-0@lo:400:kworker.0 Request processed in 149us (2674us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853273.837233:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787853273.837255:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787853273.837261:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493c58de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874699552410624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853273.837298:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493c58de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874699552410624:12345-0@lo:400:kworker.0 Request processed in 37us (2681us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853273.837304:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:2.0:1787853273.837329:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787853273.837877:0:16560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552410880 00000100:00100000:1.0:1787853273.837941:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f493c58fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874699552410624:0@lo:400:kworker.0 00000100:00100000:1.0:1787853273.837968:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f493c58d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1874699552410752:0@lo:400:kworker.0 00000100:00080000:1.0:1787853273.838025:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787853273.838060:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787853273.838066:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493c58e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874699552410880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853273.838117:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493c58e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874699552410880:12345-0@lo:400:kworker.0 Request processed in 51us (3766us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853273.838124:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787853273.838159:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f493c58c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1874699552410880:0@lo:400:kworker.0 00000100:00100000:1.0:1787853273.838211:0:15013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552410368 00000100:00100000:1.0:1787853273.838217:0:15013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552410368 00000100:00100000:1.0:1787853273.838246:0:15013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552410496 00000100:00100000:1.0:1787853273.838249:0:15013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552410496 00000100:00100000:1.0:1787853273.838274:0:15013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787853273.838280:0:15013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493c58cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3308:x1874699552410368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853273.838320:0:15013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493c58cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3308:x1874699552410368:12345-0@lo:400:kworker.0 Request processed in 40us (4068us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853273.838327:0:15013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787853273.838338:0:15013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787853273.838344:0:15013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493c58c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1874699552410496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853273.838373:0:15013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493c58c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1874699552410496:12345-0@lo:400:kworker.0 Request processed in 30us (3970us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853273.838379:0:15013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:1.0:1787853273.838394:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787853273.838412:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f493c58c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874699552410496:0@lo:400:kworker.0 00000100:00100000:1.0:1787853273.838439:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f493c58f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874699552410368:0@lo:400:kworker.0 00000100:00100000:3.0:1787853273.840917:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552410240 00000100:00100000:3.0:1787853273.840964:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552410240 00000100:00100000:3.0:1787853273.841042:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1787853273.841053:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493d128450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a76e730b-0783-4789-a5e2-a4230bb4bd66+19:3307:x1874699552410240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853273.841162:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493d128450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a76e730b-0783-4789-a5e2-a4230bb4bd66+19:3307:x1874699552410240:12345-0@lo:400:kworker.0 Request processed in 111us (6678us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853273.841171:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1787853273.841250:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f493c58e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a76e730b-0783-4789-a5e2-a4230bb4bd66:3307:1874699552410240:0@lo:400:kworker.0 00010000:00010000:3.0:1787853273.841337:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787853273.844046:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787853273.844083:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f493c58f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874699552411008:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787853273.844194:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853273.844278:0:15017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699552411008 00000100:00100000:1.0:1787853273.844289:0:15017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699552411008 00000100:00100000:1.0:1787853273.844353:0:15017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787853273.844363:0:15017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493c58c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874699552411008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787853273.844412:0:15017:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787853273.844466:0:15017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493c58c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874699552411008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853273.844475:0:15017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787853273.844540:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f493c58f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874699552411008:0@lo:13:osp-pre-1-0.0 00000001:00080000:1.0:1787853274.437023:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934596 is committed 00000001:00080000:1.0:1787853274.437044:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934595 is committed 00000001:00080000:1.0:1787853274.437052:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00010000:00010000:1.0:1787853274.863374:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787853274.965066:0:16602:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: /mnt/lustre/d1c.sanity-pcc/f1c.sanity-pcc expected pcc state: readwrite, but got: none 00000040:00080000:1.0:1787853274.986899:0:14361:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787853274.986910:0:14361:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787853274.986961:0:14361:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1787853274.986967:0:14361:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1787853275.881734:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787853275.970864:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853275.970909:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1787853275.970953:0:15013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526211840 00000100:00100000:3.0:1787853275.970962:0:15013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526211840 00000100:00100000:3.0:1787853275.971021:0:15013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 20 00000100:00100000:3.0:1787853275.971032:0:15013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493bee9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+6:2364:x1874699526211840:12345-192.168.204.1@tcp:16:kworker.0 00000100:00100000:3.0:1787853275.971151:0:15013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493bee9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+6:2364:x1874699526211840:12345-192.168.204.1@tcp:16:kworker.0 Request processed in 121us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853275.971160:0:15013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 20 00000100:00080000:3.0:1787853275.971183:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787853275.972076:0:15019:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699526211712 00000100:00100000:1.0:1787853275.972083:0:15019:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699526211712 00002000:00100000:1.0:1787853275.972117:0:15019:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x22:0x0] (0->8) req@ffff8f493beea1c0 x1874699526211712/t0(0) o4->4aa20631-d4eb-4b29-be9a-2c435d75f6dd@192.168.204.1@tcp:451/0 lens 504/0 e 0 to 0 dl 1787853286 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:1.0:1787853275.972127:0:15019:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff8f493beea1c0 with x1874699526211712 ext(0->8) 00002000:00010000:1.0:1787853275.972144:0:15019:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8f493beea1c0 00000100:00100000:1.0:1787853275.972178:0:15019:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 0 00000100:00100000:1.0:1787853275.972187:0:15019:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f493beea1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+6:2364:x1874699526211712:12345-192.168.204.1@tcp:4:bash.0 00000100:00100000:1.0:1787853275.975084:0:15019:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f493beea1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4aa20631-d4eb-4b29-be9a-2c435d75f6dd+8:2364:x1874699526211712:12345-192.168.204.1@tcp:4:bash.0 Request processed in 2886us (4219us total) trans 8589934598 rc 0/0 00000100:00100000:1.0:1787853275.975099:0:15019:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 0 00002000:00100000:1.0:1787853275.975111:0:15019:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x22:0x0] (0->8) req@ffff8f493beea1c0 x1874699526211712/t8589934598(0) o4->4aa20631-d4eb-4b29-be9a-2c435d75f6dd@192.168.204.1@tcp:451/0 lens 504/448 e 0 to 0 dl 1787853286 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:1.0:1787853275.975121:0:15019:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff8f493beea1c0 with x1874699526211712 ext(0->8) 00002000:00010000:1.0:1787853275.975127:0:15019:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8f493beea1c0 00010000:00010000:1.0:1787853276.907756:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 30506 lines, 30506 kept, 0 dropped, 0 bad.